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Foreword 



Site-based managenienl, high-stakes student testing, professional 
teaching standards, school choice — these are a few examples of the 
many educational reform initiatives that have aimed to increase the 
accountability of schools over the past decade and a half. For those in 
educational leadership roles, one consequence of this reform “Zeit- 
geist" has been the expectation that their decisions will be data driven 
as never before. It seems fitting, in such a context, that decisions 
about leaders themselves also be more data driven. This concise and 
highly readable book by Larry Lash way offers practical advice and 
resources toward that end. 

Intended primarily for those with districtwidc responsibilities, 
this is a “how to” book for .school- leader selection, apprai.sal, and 
development. It is written extremely well with this audience in mind. 
And while the author touches, of necessity, on only a sample of the 
total set of leadership instruments that are available, he provides quite 
useful guidance for district administrators no matter which leadership 
instruments they .select for their own purposes. 

The rationale for leadership assessment, along with the dangers 
to be avoided in .such assessment, are explored in the first chapter. 
Examples sprinkled throughout the chapter give practical meaning to 
these issues, which all too often have been pre.sented only in abstract 
terms. 

An overview of various perspectives on leadership is found in the 
second chapter. A selective review of the non-school- leadership 
literature is followed by a brief treatment of the .school-lcader.ship 
literature (nothing is .said about in,structional leadership, however). 
Examples ofinstruments used to assess leadership viewed from each 
of the different perspectives arc referred to throughout the chapter. 
One of the main puqwses for thi.s and the next two chapters is the 
seemingly obvious but often overlooked interdependence of the needs 

vii 
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of one’s clislrict, the forms of leadersliip best suited to meet those 
needs, and one’s choiec of leadership-assessment instrument. 

Cliapters 3 and 4 address two related issues: how to seleet or 
customize an instrument for your own district (chapter 3); and how to 
interpret and use tlie data generated by such an instrument to improve 
leadership in your own district (chapter 4). Most of the technical 
issues of which one needs to be aware in selecting and using primarily 
quantitative, survey-type instruments to assess leadership are exam- 
ined in these chapters. Lashway does this job exceptionally well, 
offering highly accessible accounts, with illustrations, of such mat- 
ters as instrument validity and reliability. 

A selection of nearly twenty instruments for assessing leader- 
sliip, most available from commercial sources, are described in the 
fifth and final chapter of this brief book. For each instriinient, this 
description consists of its purpcises, b:isic features, nature of the 
feedback provided by the instrument, and the followup recommended 
in response to such feedback. Information is also provided about the 
theory (if any) on which the instrument is based, how to administer 
the instrument, statistical validation data about the instrument (if 
available), uses, costs, and address for more information about the 
instrument. 

This book fills an important niche in educational measurement. 
Lashway speaks directly to the practictil information needs of busy 
senior administrators. He does this by stripping away the often obtuse 
language used to present information that is. nonetheless, extremely 
important for school executives to consider in their decision-making. 
F'urlhermore, his book aims to bring greater rigor to an area of their 
decision-making that has, arguably, the greatest long-term impact on 
their districts. 

Kenneth Leithwood. Ph.D. 

Director and Professor 
Centre for Leadership Development 
Ontario Institute for Studies in Education 
llnivers'ty of Toronto 
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I ntroduction 



.^^mcncims have Inny had a love-hale relulionship wilh lesliiig. As 
a luuion ihat values a practical, no-nonsense approach to daily life, 
we are inirigucd by the notion that thirty to sixty minutes with paper 
and pencil can cut through our foggy perceptions to provide a reli- 
able, valid mcasttre of the cpialities we cherish, from inteliigcnce to 
vocational aptitude. Popular magazines learned long ago that a sure- 
fire way to capture readers' attention is to offer a simple ten-ininutc 
quiz that claims to reveal readers’ personality, emotional intelli- 
gence, or marital compatibility. 

At the .same time, we've learned to be suspicious of insirumcnls 
that promise so much yet often deliver so little. Virtually all of us 
have had the experience of taking a test at school that somehow failed 
to capture the knowledge in our heads. If that can happen on a simple 
academic test, what can wc expect from instruments that purport to 
measure intelligence, personality, or leadership? 

Thus, when the KRIC Clearinghouse on Rducational Manage- 
ment asked me to prepare a book w'ith the title Measitritifi Leader- 
ship, 1 accepted the assignment with .some ambivalence. While 1 
knew enough about testing to respect the ability of a well-designed 
instrument to capture subtle aspects of human behavior. 1 had also 
spent enough time in schools to appreciate the complexity of the 
K-12 environment. I wondered whether any test could pinpoint the 
qualities needed to lead such unruly institutions. 

But as 1 read the testing literature I found evidenee that formal 
as.scssment could provide insights into dimensions of leadership that 
might otherwise go unnoticed. As I examined numerous instruments 
(and took advantage of the opportunity to assess my own leadership 
qualities), I was imprcs.scd th.it so many of them arc thoughtful, well- 
designed, and relevant to school leadership (even when they have not 
been designed for that environment). In the process. 1 learned some 
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things about my own approach to leadership, and was stimultited to 
think about how it could be improved. My exploration into leadership 
assessment left me with little doubt about its potential value. 

Yet my re.search also underscored the hazards of taking test 
results out of context. It was clear that the.se tests were not tapping 
into some universal leadership “essence.” Each instrument uses dif- 
ferent definitions and strategies to asse.ss leadership qualities, and 
each offers a different lens through which leadership can be viewed. 
Simply learning the score is of little value unless the underlying 
model is understood. Productive leadership assessment requires carc- 
ful attention both before and after the test has been administered. 

Thus, this boiik focuses le.ss on detailed descriptions of instru- 
ments than on a process that begins with rctlcction on the district's 
leadership needs and ends when participants begin to act on the 
implications of the results. My hope is that both district officials and 
principals will find practical guidance in this discussion. 

As with most ERIC' publications, this volume is a work of 
synthesis, designed to report on the exi.sting literature rather than to 
create new theories. However, any synthesis inevitably requires j)er- 
sonal judgments and interpretations. In the attempt to formulate a 
coherent picture from diverse sources, 1 may have seen implications 
or made connectittns that the original authors did not intend. 1'hus, 
reailers should not regard the material in these pages as the final word 
on the subject, but only as an initial recommendation that should be 
freely challenged and adapted through their own insights and experi- 
ences. 

I want to express tny appreciation to the C’lcaringhou.se for 
offering me the opportunity to write this volume. I owe a special debt 
to Stuart Smith, whose patience I .severely tested but whose .support 
was unflagging. Additional thanks go to Mike Krigelski. superinten- 
dent of schools in Centreville, Michigan, who.se commonsen.se com- 
ments put a human face on the testing process. 

As always, a work of this type relies on aecess to good libraries, 
and I've been bles.scd with an ahtmdance of rich resources, including 
The Evergreen Stale College. Pacific Lutheran f iniversity. the Wash- 
ington State Library, and Olympia Timbcrland Library. Their assis- 
lanee made a difficult task much easier. 
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C 

kJincc anqicnt times, people have searched for 
ways oi' idenfifying leaders who would be strong 
enough, brave enough, or smart enough to guide 
(Item through perilous limes. In today’s schools, 
tliai need is stronger than ever. 

While many schools continue to use informal nielJi- 
ods of assessing leadership, some tire moving to- 
ward .systematic metisuremcnt of leadership quali- 
ties. Through the thoughtful use of well-designed 
inslnimenls or activities, schools can add dcptJi, 
breadth, :ind objeoiiviiy to tlieir assessment of ad- 
ministrators. 

('asual orcarcle.ss use ol' measurement iii.staimcnts. 
however, can give misleading results. Schools must 
ehoo.se carefully from the wide variety of tools 
available, ranging from paper-aml-penci! tests to 
l)eif(.)rnumce assessments. 



This C.'liapter’s ('ontent.s; 

The Search lor Measurement 
The Case for Systematic Measurement 
1'ho Dangers ol' Measurement 
How Is leadership Tc.stcd? 
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The yVieasure of 
a Leader 



vv hen ihe great King IJthcr died, the kingdom fell inlo greal 
peril, lor he had no heir and many wished to rule the land. The 
Bishop called the lords together to pray and await some divine 
sign saying who should be king. And when they had done so, they 
loLuid in the churchyard a great stone in which was embedded an 
anvil, and in the middle of the stone and anvil was a sword, on 
which was written: Whoso Pullcth Out This Sword From This 
Stone and Anvil, Is the True and Riglitfiil King. Many great lords 
took their turn at trying to wrestle the sword out. hut none could 
move it the least bit. d'hen came the boy Arthur and easily pulled 
out the sword, which was called Kxcalibiir. Seeing this, the great 
lords knell and recogni/cd him as king. 

— Fhiglish legend 

IV^oclern organi/ations can only envy the deni/ens of Camelol, 
who could count on divine inlervenlion to anoint Iheir leaders. Arthur 
prt)ved his worth with a task that was simple, heroic, and unambigu- 
ous. 

'Foday the challenge of idenlirying leadership qualities seems 
complex and confusing. Consider the following scenarios: 

As the last candidate left the interview room. Marcia Trulo 
leaned hack, ihoiighi for a moment, and announced a 10- 
miiuile break. After a full day of interviewing applicants for 
the Mcadowxlalc position, her Executive Council needed 
lime to stretch and refresh — and she needed lime to think. 
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On paper Ihe five candidates all looked good — not much to 
separate them. One of them had a rather shaky interview, but 
the other four all came across well. They had differing 
patterns of strengths and weaknesses, but overall none was 
head and shoulders above the rest. On that analysis, perhaps 
any of the four would be good choices. But she could recall 
some other new hires whose performance failed to match the 
impre,ssion they created during the interviews. 

Given all that was happening at Meadowdalc — changing 
boundaries, high faculty turnover, and declining test scores — 
they couldn't afford an unlucky guess; As .she thought back 
on the interviews, .she tried to identify some sign — however 
small the clue — that this was the person with the necessary 
leadership qualities. 

Mark Lee sat at his desk staring out the window. The student.s 
had left two days ago. the last teacher had turned in keys an 
hour ago. and his end-of-year reports weren't due for a week, 
so it was a rare moment for reflection. He couldn't believe 
how fast his first year as principal h,.d gone, and at this point 
he vva.'-n't even sure how it had gone. 

His university classes had taught him some good techniques 
for getting things done, but they hadn’t told him much about 
assessing his effectiveness. He had felt off-balance all year; 
piojeets he had been really nervous about went off without a 
hitch, while .seemingly benign issues had suddenly blos- 
somed into coni itious debates. 

Overall, things had moved forward a little, but Lee hadn't yet 
convinced himscli'that he had the leadership qualities to take 
this school where it needed to go. He knev,/ there were some 
things he needed to improve on, like organi/.ation, but he just 
didn't have an overall sense of direction. 

Both Truk) and Ix’C arc looking for a reliable wtiy to measure 
leadership. Trulo wants to determine which candidate has enough of 
the right qualities; Lee wants to know how to improve his own 
qualifications and skills. 

Why should this be difficult? Anyone who has worked with other 
people knows that leadership exists. There are people of whom we 
can say, "He's a leader." and everyone nods in agreement. Yet when 
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we try to pinpoint exactly what makes us feel that way, we bog down. . 
Scholars haven’t done much better, generating hundreds of defini- 
tions but little consensus. 

Leadership appears to be one of those concepts (much like “love” 
or “intelligence”) that plays a vital role in our vocabulary but that 
stubbornly resists distillation into a pure es.sence. Leadership flows 
from many sources, sometimes springing from, the joy of accomplish- 
ment, other times from a modest desire to serve others. It takes many 
forms, .sometimes visible and heroic, other times quiet and unas.sum- 
ing. It has different effects in different environments; a strategy that 
succeeds brilliantly in one organization may completely fail in an- 
other. 

Given all that, is there hope for Trulo and Lee? Can we move 
beyond raw intuition and gut-level hunches to assess leadership 
systematically and reliably? The answer is a qualified yes. While 
there is no Excalibur test — no heroic task to reveal divine favor — 
there are many tools that can help those who wish to choose leaders or 
assess their own leadership qualities. This book is designed to pro- 
vide an introduction to the measurement instruments that can help 
school leaders. 



The Search for /Vleasurerrient 

Edward Thorndike, the great educational psychologist, once 
summed up his worldview by saying, “Whatever exi.sts at all exists in 
some amount.” In principle, everything — no matter how abstract or 
complex — could (and should) be measured. The role of scientific 
psychology was to find objective, reliable yardsticks for human 
behavior. 

Thorndike was a towering figure in his lime, and his optimistic 
views permeated the educational e.stablishment, spurring several gen- 
erations of educators to validate their work with numbers. Tests were 
designed to assess intelligence, academic achievement, musical abil- 
ity, handwriting, and dozens of other qualities. The corollary to 
Thorndike’s credo soon became “If it exists, .someone will try to 
measure it.” 

Today educators are more skeptical of “scientific objectivity,” 
but the desire to capture elusive qualities in numerical form remains 
strong. Nowhere is the need more strongly felt than in the leadership 
domain. 
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High Stakes 

Schools have always needed strong leadership, but the stakes 
have never been higher than they are today. Consider: 

• Demographic and cultural shifts are creating increasing num- 
bers of the students that schools have traditionally been least 
successful in helping. 

• Social changes are sending students to school with needs that 
go far beyond the academic. 

• Public expectations have risen, demanding that schools not 
only help students reach higher standards but that they be 
sensitive to individual differences in style. 

• A growing number of critics have suggested that the public 
edueation system as a whole should be scrapped; radical 
reforms such as voucher plans now receive more serious 
support than ever before. 

• Even defenders of public education now agree that serious 
restructuring is in order. 

Several decades ago. school boards could expect satisfaction if 
they hired leaders who were congenial, hard-working, and organized 
enough to get their paperwork done on time. Whatever shortcomings 
these leaders had could be easily smoothed over, and no one doubted 
that school would continue to run in much the same way it always 
had. 

In today's volatile environment, schools pay a much higher price 
for a poor choice. If a new principal docs not have the necessary 
skills, progre.ss grinds to a halt while the entire .school tries to cope 
with the resulting confusion, disappointment, and conllict. Often the 
failing leader becomes the dominant issue in the minds of teachers 
and parents. Equally damaging is the new leader who is just compe- 
tent enough to avoid overt trouble, but who does not take the school 
in any particular direction. Years may pass before his inaction or 
indccisivcness suddenly explodes into a crisis. 

The stakes arc equally high for professional development. No 
preparation program can prepare leaders for everything they will 
encounter in their careers. Today's leaders must be learners, swiftly 
making adjustments to a rapidly changing environment. Without 
accurate feedback about their performance, their self-improvement 
efforts will falter. 
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The Measurement Continuum 

When leaders and their supervisors become dissatisfied with 
informal or intuitive appraisals, they usually look for some kind of 
lost that will identify leadership qualities in tangible, precise ways. 
What they envision is what we have come to associate with testing: an 
instrument that will reduce complex behaviors to a set of numbers 
that can be objectively ranked, compared, and analyzed. In this 
common view, the choice is between measuring or not measuring. 

However, the reality is more complicated. Measurement actually 
exists on a continuum (see figure I). At one end. measurement is 
intuitive, impre.ssionistic. and inexact. We may merely decide that 
one person has “more” of the desired quality than another, but this is 
still a measurement. (The old phrase “taking his measure” captures 
this idea, suggesting the almost instinctive way that people size up 
others, trying to locate their place on .some scale of skill, courage, or 
other quality.) 

At the other end of the continuum, leadership is as.sessed through 
systematic data in numerical form. The goal is to render a judgment 
that is less influenced by surface appearances and human biases. 
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iVteasurement of Leadership 
as a Continuum 




Scope 


Precision 
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{intuiii\(\ Validity 

Ap()rn\imdU‘i 


Objectivity 





As we move toward Ihe right side of the continuum wc gain four 
advantages. 

I. Objectivity. Objeclivily means that the same criteria are ap- 
plied in the same way to everyone. For example, on an objective 
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assessment, each candidate is asked the same questions, and the same 
criteria are used to rate each response. When objectivity is present, 
test users are assured they aren’t comparing apples to oranges. In 
contrast, the typical informal interview is idiosyncratic, a dialogue 
that wanders off in unpredictable directions. One applicant may get 
favorable marks for her response to a question that another applicant 
isn’t even asked. 

2. Validity. Validity means that the criteria being used have a 
relationship to the quality being as,sessed. A candidate may give a 
seemingly apt response to a question in an interview, but does that 
response have any relationship to later success on the job? Formal 
tests frequently address that question in systematic ways. For ex- 
ample, given the scores on a leadership test, we can locate the 
subjects several years later and see whether their scores on the tc.si 
relate to their sucee.ss on the job. Do high scorers tend to be judged as 
outstanding performers in the field? Do low scorers encounter diffi- 
culties on the job? Such studies are difficult and expensive to carry 
out (and not every test goes to this length), but most formal measures 
have been validated in some way. 

3. Precision. Precision allows us to make fine distinctions rather 
than crude estimates. For example, a principal doing an informal .sclf- 
as.sessment may recognize that she is good at re.solving conflicts, but 
a formal test may tell her that she scores at the ninety-ninth percentile 
in conflict resolution. The difference? The quantitative score may 
lead her to see this skill as a unique strength that should be cultivated 
and expanded. On most formal tests, the precision is particularly 
valuable because it allows us to compare leaders with a much broader 
reference group than we could find at the local level. That is, we can 
know how a leader rates among a representative national sample, not 
ju.st the handful of leaders we know personally. 

4. Scope. Formal tests generally cover a broader spectrum of 
qualities and skills more efficiently than we could do informally. For 
example, the Educational Administrator Effectiveness Profile (Hu- 
man Synergistics) offers 1 20 items that tap 1 1 key leadership skills in 
le.ss than an hour. Because each skill area is probed with multiple 
questions, there is little chance that any single rcspon.se can dominate 
the outcome (as may happen with unstructured interviews). 

Viewing measurement on a continuous scale helps us recognize a 
crucial point; all as.scssment involves human judgment. At one end of 
the .scale, the judgment is informal, intuitive, and approximate; at the 
other end it is systematic, objective, and precise — but only relatively 
.so. No matter how sophisticated the calculations or how extensive the 
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validation studies, every test embodies human judgments about lead- 
ership and how it can be measured. That is, at some point, the creators 
of the test have faced — and answered — the crucial questions, “What 
is leadership?” and “How can it best be measured?” Every test 
answers these questions in different ways, and every test will mean 
something different than any other test. 

The Case for Systematic Measurement 

In many school districts, leadership is measured on the left end of 
the continuum. For example, the hiring process begins with a screen- 
ing of resumes in which screeners match the materials against some 
list of desired attributes (implicit or explicit). Once the candidates 
have been whittled down to three to five, they are brought in for 
interviews, which are frequently loose and improvisational, often 
opening with, “Tell us a little about yourself’ and meandering along 
an unpredictable path. The result? Leaders are chosen on impressions 
and idiosyncratic perceptions of “fit” rather than merit (Mark Ander- 
son 1991). 

Some districts have attempted to move this process further to the 
right on the measurement continuum. Before reviewing resumes, 
they explicitly list desired criteria and then check off the ones they 
find on each resume. In setting up interviews, they identify specific 
issues that should be addressed and make sure that each candidate is 
a.sked those que.stions. Sometimes the interviewers rate the answers 
numerically. Throughout the process, some schools attempt to reduce 
the effect of subjectivity by involving multiple parties in the selection 
process (Anderson). 

The same picture is apparent in the professional development of 
school leaders. In many cases, leaders are left to ponder their strengths 
and weaknesses on. their own, based on whatever day-to-day feed- 
back they’ve picked up from teachers, parents, and other administra- 
tors. They may be evaluated for accountability purposes, but admin- 
istrators get little systematic feedback that could be used for profes- 
sional development (Anderson). 

Here again, however, some districts have attempted to move 
toward more systematic measurement. A number of districts have 
implemented carefully designed assessments that provide “360 de- 
gree feedback” in which leaders are assessed by superiors, subordi- 
nates, peers, and others in the school environment (Richard Manatt). 

In summary, much of leadership assessment has been unstruc- 
tured and informal, but some di.stricts are seeking to make their 
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practices more systematic and precise. Are these districts on the right 
track? Will formal measurement of leadership yield richer, more 
accurate information? The answer is “yes.” 

Informal or intuitive judgments can be easily influenced by 
extraneous factors — physical appearance, self-confidence, and ap- 
parent fit with community values (Anderson). What one secs in an 
hour-long interview is exactly one hour of behavior, mostly verbal, 
carefully crafted to create a certain impression. Certain qualities and 
skills may fail to surface altogether (for example, a candidate’s ability 
to build and maintain relationships with teachers). 

Mike Krigelski. superintendent of schools in Centreville, Michi- 
gan, uses the Principal PerceiveriGaWup Organization) as part of the 
selection process, because it picks up strengths in candidates who 
may not interview well. He recalls one applicant who “didn’t have the 
knockout look,” but who turned out to be caring, dedicated, and 
appreciated by student.s — Cjualities the Pcrcc/vcr recognized. Noting 
that interviews are often a matter of impre.ssion management, Krigelski 
wryly observes, “1 trust my gut, but sometimes it turns out to be just 
gas.” 

Self-assessment (the most common form of assessment for pro- 
fessional development) is also notoriously susceptible to bias and 
blind spots. Leaders’ self-assessments are frequently more positive 
than that of superiors and subordinates (Bernard Bass). 

Kenneth and Miriam Clark (1996) argue that information that is 
collected systematically and combined objectively provides better 
predictors of performance than observer judgments — even when the 
observer is highly qualified and knows the candidate well. 

The benefits of systematic measurement can be seen more clearly 
by using the Johari window, a tool frequently u.sed for analyzing 
interpersonal communication (Hanson). 

The Johari window, di.splayed in figure 2, simply shows the 
different ways that people’s skills, values, and personal qualities can 
be known or not known to themselves and others. Each quadrant of 
the window represents a different degree of knowledge of an indi- 
vidual by .self and others. 

1 . Qualities known to an individual and to others are part of the 
"open self ” For example, a leader sees herself as being “supportive." 
and those who know her agree. In this case, a leadership test seems 
supcrlluoiis, since everyone is already aware of the leader’s charac- 
teristics. But a credible formal test can confirm the congruence 
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The Johari Wiiidc v 



Self- Percept ions 

Thiiiiis yon know Thinf>s you don ’! know 



What 

others 

know 



What 

others 



The Open Self 


The Blind Area 


The Concealed Self 


The Unknown Self 



between seU-pciccption and others' perception, elevating the quality 
from “something 1 ean do" to “something that is a real strength." 

2. Qualities known to others but not to the individual are part of 
the “blind area. ’’ Here is where formal feedback from others carries 
real value. For example, a principal may be completely unaware that 
certain behaviors arc creating an aura of “aloofness"; getting that 
feedback in a structured way ean serve as a wakeup call, raising all 
kinds of productive questions about v.diy this is the case and what can 
be done about it, 

?i. Qualities known to the individual hut not to others are part of 
the "concealed .self . " A leader may present the appearance of an 
organized, efficient manager yet be aw'are that behind the scenes his 
use of time is often unproductive or undisciplined. A good test may 
be useful in two ways in such a ca.se. First. ;i skillfully designed 
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insirumeni may draw out responses that the leader would not directly 
state to others; what has been concealed is now revealed. Second, 
seeing in black and white that one’s facade has been successful may 
make a leader uncomfortable enough to do something about it. 

4. Qualities that are unknown to both the seif and others are in 
"the unknown self ” At first glance, it seems as if tests would be of 
little help here; if people aren't aware of certain qualities, how will 
the test pick them up? Part of the answer is that tests often focus on 
concrete behaviors that are known, but then go on to establish 
connections that reveal larger themes. For example, a principal may 
routinely make a point of returning all phone messages before leaving 
each day, but not recognize this as an indicator of skill in interper- 
sonal communications. The test will point that out. 

In addition, viewing the results of a test may encourage leaders to 
reflect on their strengths and weaknesses, sometimes leading to 
di.scoveries that the test per sc did not reveal. For example, a leader 
pondering high scores in “dominance” or “directiveness” may sud- 
denly realize that those behaviors are not a consciously chosen 
strategy but an echo of his relationship with his father. 

Users of the Johari window generally believe that performance 
and relationships improve when the open self expands and the other 
areas shrink. That is, when a leader's qualities are known by the 
leader as well as by others, the leader will function better (Hanson). 
Formal tests can play a major role in that process. 



The Dangers of /Vleasurement 

A well-designed program for measuring leadership is a valuable 
resource for choosing and .selecting leaders, but testing is not a 
panacea, nor is it something that should be done casually. Numerous 
obstacles lie in wait for unwary school di.stricts. 

! . Poorly designed tests. Most tests generate numbers, scales, and 
even charts, creating an authoritative aura that .seems to be above 
reproach. Although well-designed tests do provide good information 
that cannot be achieved in other ways, not all tests are well designed. 
Appropriate use requires careful investigation of the test’s makeup, 
development, and .statistical validity. This is an uncomfortable issue 
for many users, who are not adept in statistics, but there arc some 
relatively simple steps that will help even nonexperts sort through the 
issues. Chapter 3 discusses these issues in more detail. 
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2. Inappropriate tests. As noted earlier, every test embodies 
some theory about the nature of leadership, and no test is completely 
comprehensive. Users must carefully evaluate their needs. How is 
leadership defined in their district? What are the most important 
leadership qualities needed for success in the local environment? 
Which test best matches the district’s needs? No matter how well 
designed the test, its validity suffers when the qualities it measures 
arc irrelevant in the district. 

3. Poor u.s'e. Testing is never just a numbers game. The scores 
generated by any test are incomplete; they must also be analyzed, 
interpreted and put into context. For example, a test may show that 
Candidate A is at the ninety-fifth percentile while Candidate B is at 
the ninetieth percentile. In practical ternts, is this difference signifi- 
cant? Does the five-point difference promise a major difference in 
on-the job-performance? Does Candidate A's superiority on the test 
outweigh the achievements on Candidate B’s more substantial resume? 
Test scores are an invitation to reflection and human judgment, not a 
substitute for it. 

The same reasoning applies when tests arc used for professional 
development. .Simply reporting results to test-takers will be of little 
use unless there is a clear pathway for following up. Are leaders 
provided with accurate inteipretations of their scores? Are they en- 
couraged to reflect on the results in a systematic way? Arc they 
provided resources for taking action on the issues that have been 
identified'.^ 

4. Ethical risks. In some respects, testing is a dehumanizing 
process. It takes the rich thought patterns of the leader and attempts to 
ab.stract a few preselected categories. Test-takers see their complex 
daily reality — the insights, intuitions, wisdom, and deeply felt val- 
ues — reduced to a set of numbers. The experience can be unsettling, 
particularly in a high-stakes setting, where jobs and promotions 
might be involved. Robert Kaplan and Charles Paulus (1994) note 
that while most leaders can handle the stress of feedback, there is 
always the chance of “pain." Pain is not always harmful, but neither 
should people be subjected to it arbitrarily. 

Consider the following .scenarios: 

• A candidate for a principalship. with an excellent record of 
achievement, is not hired because of a mediocre score on a 
leadership test that was hastily chosen by the school “because 
we want to be objective." 



23 



16 MEASURING LEADERSHIP 



• An enihusiastic first-year principal is dismayed to find that 
teacheis have rated him as “average” on a majority of items; 
the feedback results have simply been placed in his mailbox 
with no further explanation. 

• 'fhe school board decides that the district's 36()-degrec-feed- 
back results will be used to determine salaries and promotions; 
the instrument has been developed locally, with no field test- 
ing and validation. 

In all these eases, careers may be damaged because districts have 
exercised little care in choosiim and usinsi test instruments. At a 

i-T 

minimum, test users mu.st have a clear, defensible purpose in admin- 
istering a test and must use the results in an appropriate and produc- 
tive way. 

How is Leadership Tested? 

Leadershiii assessment c;m take many forms, each of which has 
advantages and disadvantages. This section discusses the range t)f 
tkHils available to schools. 



Inliiilivt' Jud|-’mtMits 

Measurement experts have often eritiei/.ed the use of . subjective 
Judgments (as in an unstructured interview), and they can point to 
evidence that as.sessors may be unduly inllueneed by peripheral 
factors that have little to do with long-range leadership effectiveness 
(Anderson). 

Yet the persistent use of such judgments suggests that praetititv 
ners have found them to be a source of useful information. Even 
administrators who use h)rmal assessments would be reluctant to hire 
someone sight unseen, based only on a set of test scores. So it may be 
worth asking what assessors can glean from an unstructured facc-to- 
faec meeting. 

One possibility is demeanor. How do candidates present them- 
selves? Are they good listeners? Do they speak with assurance and 
appear to be comfortable with themselves? Do their appearance and 
manner say “leader”? These may appear to be nebulous or even 
superficial qualities, but school leadership requires intensive inter- 
personal interactions; candidates who can present themselves persua- 
sively in an interview may be able to do the .same in other situations. 
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Philosophical compatibility is another useful piece of informa- 
lion that can come from interviews. Either through targeted questions 
or spontaneous discussion, assessors can often gel glimpses of a 
eandidalc's worldview, allowing predictions about potential har- 
mony or dissension. (Some critics point out the danger of ’■groupthink.'' 
in which members of an organi/.iilion continually seek to clone 
ihemselves. screening out new ideas and .stilling creativity. While 
that risk is real, few districts would find it sensible to hire someone 
who would try to turn the organi/,aiion 180 degrees from its chosen 
path.) 

In general, intuitive Judgments can be useful in determining “fit." 
Without interviews, for example, we could anticipate many more 
cases of leaders getting into personality conlliels or philosophical 
disputes. Where informal assessments fall short is in assessing 
“merit" — the actual skill level of the candidate. Being able to talk 
about one's strengths, or even relating a story that illustrates those 
qualities, is a far cry from actually demonstrating the skills. 



PcM lorm.inc o Jucl^mc'nls 

Intuitive judgments require a leap of faith that the behavior we 
.see in the interview can be translated into effective behavior on the 
job. A more reliable judgment might come from observing how a 
person actually performs in a school setting. Will that pleasant smile 
evaporate when confronted with a demanding parent? Will the well- 
rehearsed recitation of ctlucalional vision turn to mush in the give and 
lake of a faculty meeting? Observing on-the-job performance can 
answer many of those questions. 

Performance assessments generally come from four sources. 

1. SniH'iinrs. The most common form of on-the-job observation 
comes from superiors. W'ho arc generally assumed to be senior, more 
knowledgeable, and more highly skilled than the people they super- 
vise. Superiors are especially able to provide fectlback on the leader's 
ability to accomplish assigned tasks. In some settings (paniculaiiy 
smaller organi/.alions). they may be able to provide information on 
how' the leader interacts with peers and subordinates. 

2. Peers. People occupying similar roles can often add insight 
into a leader's perfoimance. From their own experience, they know 
what the job requires, and they can often gel beneath the surface 
behavior to make thoughtful inferences about thcireollcaguc's thought 
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processes. Some studies have suggested that peer ratings may be 
more predictive than ratings by superiors (Bass). 

3. Subordinates. Leaders, according to one popular definition, 
are people who have followers. Thus, it makes sense to tap followers' 
perceptions. Those on the receiving end of the leader’s actions often 
have a keen awareness oi' what is and is not working, and they may be 
highly perceptive about the reasons. 

4. Self. Mtiny leaders are capable of rating their own peiformance 
honestly and frankly (if not objectively). In particular, leaders know 
better than anyone why they do what they do. They have a rich 
knowledge of their intentions, hopes, and values, and they can ex- 
plain the thinking behind their strategies. Hovv'ever. they may not 
always recognize the way their actions are perceived by others; some 
research shows <i wide gap between self- assessments and the assess- 
ment of others (Bass). Yet self-assessments can be useful as a .starting 
point that will place the feedback of others into an understandable 
context. 

Wliilc observations of job performance can provide excellent 
insight into a leader's .skills, they also carry a number of disadvan- 
tages. 

First, every human being secs the world through a particular 
“filter” that reflects his or her values, experiences, and aspirations. 
That filter not only affects our interpretation of another's behavior, it 
may even keep us from seeing things that would be obvious to 
.someone with a different filter. For example, someone wilh a bent for 
brisk efficiency (a single-minded focus on the task at hand) will be 
likely to notice and value that trait in a subordinate, while his radar 
completely fails to pick up another subordinate's gift for warm, 
positive relationships. 

Second, superiors, subordinates, and peers may have limited 
pcrspeclive. No one is likely to have a compreheitsive picture of a 
leader's performance. Superintendents, for example, may be able to 
comment perceptively on how well principals communicate with the 
central office but know le.ss about their communication w'ith faculty. 
Similarly, teachers may be highly aw'arc of the principal's behavior in 
a few key areas (.such as supporting them on discipline issues), but he 
only vaguely aware of how he or she is handling other leadership 
tasks. (In such ca.scs, ratings may depend more on the raters’ state of 
mind than on careful analysis of the leader’s behaviors. If teachers arc 
happy, they may give high marks on mo.st questions on the grounds 
that the principal must be doing something right.) 
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Third, assessments that have high stakes (promotion, hiring, and 
so forth) can be affected by niicropolitical issues (Bas.s). A superin- 
tendent angling to remove a principal may rate her lower on many 
items to help make the case for a dismissal. Teachers may be dissat- 
isfied with some parts of a principal's performance but rate him high 
because they know they can at least live with him. 

These disadvantages are dangers, not fatal flaws. To some de- 
gree. they can be countered by providing tnultiple ratings from 
different perspectives. A growing trend is the use of “36()-dcgrec 
evaluation." which uses fc'dhack from all group.s — superiors, peers, 
subordinates, and sometime others (Manalt, Craig Chappelow). 



.S i n n 1 1 atod f rfo rma n 

.Assessment of on-the-job performance is an especially helpful 
tool in professional development, since superiors, subordinates, and 
peers are readily available to give their opinion. However, it is less 
practical when selecting new leaders from outside the organization. 

One alternative is measuring performance through simulated 
work activities. The best-known example i,s the "in-basket" exercise, 
in which candidates are given a list of typical action items (such as 
phone messages, memos, reports) that might appear on a leader's 
dail)- agenda, and asked to handle them Just as they would in real life 
( .3ass). 

•Such simulations can be done informally on the local level, or 
they can be expanded into a formal set of procedures carried out at an 
"assessment center." In the best known educational example, the 
National Association of Secondary School Principals runs centers 
around the coutitry that as.scss leaders or potential leaders on a variety 
of skills. 



I ’.i| -iind-i ^t'nc'i I Tests 

What people most often associate with the term “test" is a written 
instrument containing anywhere from a dozen to a hundred state- 
ments or questions related to leadership behavior or beliefs. For 
example, lest takers may be asked to agree or disagree with state- 
ments about their behavior such as: 

• 1 IVequently walk around the building just to slay in touch. 
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• 1 never make a decision vvilhoul consulling those who wiil be 
affected. 

• 1 frequently delegate tusks to others. 

• 1 go out of my way to compliment people for good work. 

• 1 attempt to return every phone message the .same day. 

Or they may be asked to report on their beliefs; 

• Most of the time, employees can be trusted to do the right 
thing. 

• In today’s volatile environment, long-term planning makes 
little sense. 

• Maintaining good communications is the leader's most impor- 
tant task. 

• Good leaders are bom. not made. 

• It's better to introduce change a little at a time rather than all at 
once. 

Tests of this kind yield at least two helpful bits of information. 
First, the responses can be grouped thematically to provide a profile 
of the leader's beliefs or behavior in a particular area. For example. 
The Cotnprehensive Leader (HRDQ) has forty items that can be 
grouped in four areas: “know yourself." “know others." “know your 
organization. ’’ and “know the world." 

.Second, the leader’s .score can be pul in context by comparing it 
with scores of others who have taken the test. The score might be 
reported, for example, as being at the ninetieth percentile or in the lop 
quarlile of a nationwide sample of leaders who took the test. Even 
more helpfully, the scores might be compared to the scores attained 
by leaders with demonstrated success in the workplace: then a high 
pcrforinancc on the test could be viewed as a predictor of future 
success. 

In addition, papcr-and-pencil tests lend to be linie-efficicnt. sel- 
dom requiring more than an hour, and easily scored, either by sending 
them to the vendor or by using a .self- .scoring key. Users can quickly 
gel structured, comprehensive profiles of a large number of leaders. 

However, tests require considerable time and expertise to de- 
velop, .something beyond the resources of most .school districts. In 
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most cases, districts must choose a ready-made instrument and order 
it from a vendor. 

In summary, school districts have a wide array of choices in 
assessing leadership, ranging from the informal to the highly struc- 
tured. These choices are not mutually exclusive; using multiple 
approaches is possible and probably desirable (Clark and Clark). 

Unfortunately, schools do not always make the best u.se of these 
resources. Kenneth Leithwood and colleagues (1994) cite “compel- 
ling evidence” that “information generated during appraisal and se- 
lection processes is often not used or is misused.” 

Districts must be prepared to invest considerable thought and 
effort in the assessment process. Even when using ready-made instru- 
ments developed by experts, users must exerci.se judgment in choos- 
ing appropriate instruments, administering them fairly and ethically, 
and then using the results in a productive way. 
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Defining leadership is like defining love; you 
can pul the words on paper, but somehow Uicn' 
never seem to quite capture die experience. Like 
love, leadership has many dimensions and has gen- 
crafed dozens of theories, and no single test pro- 
vides a comprehensive measure. 

Over die years, various reseiirchers liavc located (he 
roots of leadership in personality traits, behavior, 
die behavioral context, or personal inspiration. The 
contending viewpoints lead to in.stmnients with 
vcr>' different content and format, none of uliidi 
has emerged as an all-puiposc tool. 

hi addition, potentially crucial issues such as values 
or racial and gender issues have not been exten- 
sively addressed by tc.stpubli,shcrs. Most iniporiaiii 
foi' K-12 administrators, measurement of school 
leadership (as oppo.sed to coiporate or political 
leadership) is raie. 

The iiiiplicatioii is clear; test users must uiKlcrslaiid 
the assumptions and definitions cniheddetl in a 
leadership inslnmienl before they can he 
sure it nialehes their needs. 

riii.s cliaptcr’.s contents: 

I .ooking at Leadership 
1 .eadership Qualities 
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What Do Leadership 

Tests yvteasure? 

l^^aking a leadership assessment can be a deceptively simple 
process. Sitting at a desk for half an hour, an executive responds to a 
series of short questions, and in a short time (often just minutes) is 
rewarded with an impressively detailed profile showing his or her 
strengths as a leader. 

But this seemingly straightforward process masks considerable 
ambiguity. Measuring leadership is not like measuring temperature, 
where we can expect that any well-made thermometer will give us 
pretty much the same result. Every leadership test makes different 
assumptions about what leadership is and how it can be recognized; 
every test uses its own language, formal, and measurement strategies. 

Thus, potential test users must understand how a given test 
defines leadership — what it includes and what it leaves out. This 
chapter provides a foundation for that understanding by examining 
the different conceptions of leadership and how they might be mea- 
sured. The first half looks at the major theoretical perspectives that 
influence the content of leadership tests; the second part discusses 
some of the specific traits, skills, and attitudes that are typically 
measured on tests. 



Looking at Leadership 

Defining leadership is a lot like trying to dismantle a marshmal- 
low: you can do it, after a fa.shion. but not very precisely, and not 
without getting your hands sticky. 

Although people have always recognized leadership, only in the 
last two centuries has it been .systematically studied (Bernard Bass). 
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In that relatively short time, hundr«.ds of philosophers and researchers 
have dissected the concept, hoping to find some “essence” that could 
explain why certain people are admired, heeded, and followed by 
others. 

As a result, there is no shortage of ideas on leadership. The most 
recent edition of the Bass and Stogdil 's Handbook of Leadership runs 
to over i.lOO densely packed pages of re.search summaries. All this 
effort has not yet converged, and likely never will, on a single, 
universally accepted view. There are dozens of theories and hundreds 
of definitions, not to mention a seemingly infinite number of books 
and seminars offering “leadership secrets." 

Although this situation is frustrating for school leaders who 
merely want .some practical guidance, it should not lead to despair or 
cynicism. Even when theories differ, they arc not always mutually 
exclusive; frequently they just rellect different dimensions of a very 
complex phenomenon. Any theory can be seen as a filter that high- 
lights certain elements of leadership while ignoring others; collec- 
tively. multiple theories give us a rich vocabulary and a multilevel 
understanding. 

However, this wealth of view points creates a practical problem 
for those wishing to use leadership tests. In effect, every instrument 
offers its own operational definition of leadership. When a test a.sks 
leadeis how often they delegate tasks, it asserts that delegation is an 
important dimension of leadership; when it asks how often leaders 
return phone calls, it assumes that communication is essential to 
leadership. 

Test makers may or may not be conscious of any particular 
theory when they write tests, hut every test reflects some implicit 
view of leadership. The following sections outline the major theoreti- 
cal perspectives and how they arc reflected in assessment. 



L c'cidorsh i p as Pc'rsrin.il Traits 

When the earliest thinkers on leadership looked at greatness they 
saw unique, almost godlike, qualities. Thomas Carlyle, who believed 
that all of human history was shaped by “the Great Matt.” boiled it 
down to a simple formula: "The great heart, the clear deep-seeing 
eye: there it lies." Leadership came from personal qualities that rose 
above run-of-the-mill humanity. 
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Modem images are less heroic (and less gendcr-spccil'ic), but 
both researchers and the general public have frequently looked for the 
sources of leadership in biography. When we examine the lives of 
leaders, it is often difficult to avoid explaining their differences by 
personality, as when we contrast two twentieth-century politicians, 
Theodore Roosevelt and Robert A. Taft. 

In Roosevelt w'e have a human dynamo whose high-energy 
appioach drove him to leap at problems and throttle them into 
submission. Taft, an Ohio senator who was a leading presidential 
contender, took a much more passive stance; 

I don't try to supply great moral illumination or .stir people 
up. There's probably only one man in a generation who can 
do that. What I do is w’ork out each problem as well as I can, 
and then if my solution suits other people, they go along. 
(Joseph and Stewart Alsop). 

Each politician's approach was so characteristic that it seems 
more plausible to explain the contrast by personality differences than 
by any conscious strategy. (It may also explain why Roosevelt be- 
came president and Taft did not.) 

The first generation of leadership research as.sumed that leaders 
possessed distinctive personal characteristics that made them stand 
out from other people. These traits were regarded as stable, hence 
measurable through psychological testing. Researchers studied lead- 
ers in all walks of life, from corporate executives to athletes to 
recreation directors. Although they found a large number of traits 
associated w'ith leadership, they were unable to formulate any simple 
explanation. Good leaders, it seemed, were intelligent, .self-assured, 
enthusiastic, healthy, energetic, sociable — but not always. At best, 
certain traits might be necessary, but never sufficient. 

As (lie list lengthened, without showing any signs of .settling on a 
few key traits, re.searchers became discouraged and concluded that 
there was no "essence" of letidership that will hold for all cases. As 
Warren Bennis remarked of the leaders he .studied, other than demon- 
strtiting certain similar abilities, they were "tremendously diverse. 
'I'hey were tall, short, fat. thin .... They evinced no common pattern 
of psychological makeup or background." 

In recent years, researchers, reassessing the role of traits, have 
concedcHl that personal qualities rlo have ait impact on leadership 
(Karin KlenkeRJ96). While few scholars are ready to argue that 
certain people are "born to lead," it .seems unreasonable to deny the 
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relevance of personal traits. The failure to reach consensus may 
simply reflect the great diversity of leaders who have been studied, or 
the wide range of methods that have been used. 

What kind of traits are we talking about? Klenke suggests three 
categories: physical (such as height, weight, and appearance); mental 
(such as intelligence): and personal (such as adaptability, self-confi- 
dence, and extroversion). 

Typically, personal traits are measured by questionnaires given 
to leaders and their associates. Originally, psychologists sought com- 
prehensive measures of broad traits such intelligence and person- 
ality. but today’s leadership tests have more modest aspirations, 
seeking only to zero in on selected personal characteristics that may 
inlluence leadership. 

For example. The Comprehensive Leader (HRDQ) seeks to mea- 
sure a trait called “Knowing Yourself." which reflects the leader’s 
awareness of personal qualities. Likewise, one theme of The Princi- 
pal Perceive r (G'dWup Organization) is called “Achiever," defined as 
"an inner drive which continuously propels them to make things 
happen and get things done." 

Personal traits can be assessed in a number of ways. The simplest 
approach is to list a number of statements and have leaders indicate 
the degree to which each statement is true of them; 

• 1 am very generous 

• I enjoy novelty 

• 1 am uncomfortable with conflict 

.Similar statements can be given to superiors, subordinates, or 
peers of the leader to get a “360 degree” view. In scoring such tests, 
clusters of related statements are u.sually grouped into themes. For 
example, the Life Styles Inventory (Human Synergistics) groups its 
questions into a dozen categories, such as “affiliati vc." 
"perfectionistic." and “oppositional " 

Another approach, used by tlic Principal Pcrceiver. asks open- 
ended questions and analyzes the leader's statements for key themes. 
This approach is less common because of the time involved for 
scoring and assessing answers. 

C C 

Despite the somewhat diminished appeal of the trait approach 
among researchers, many practitioners continue to link leadership 
with personal qualities and thus find it meaningful to assess such 
qualities. 
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Leadership as Behavior 

When researchers became disenchanted with the search for es- 
sential personal traits, they speculated that behavior rather than 
personality might separate successful from unsuccessful leaders. 

Investigation showed that most leader behaviors could be grouped 
into two broad categories called “task orientation” and “relationship 
orientation.” Task-oriented behaviors are aimed at getting the job 
done: communicating expectations, evaluating results, planning 
projects, and so forth. Relationship-oriented behaviors involve the 
interpersonal dimensions of leadership: conveying trust, empathiz- 
ing, resolving conflicts, and related behaviors. Over the years these 
two categories have proved to be a useful way of de.scribing leader 
behavior. 

Although researchers immediately began to ask which set of 
behaviors was most important, they have never arrived at a clcai' 
answer. Hence, leadership instruments often attempt to measure both 
kinds of behavior, though some emphasize one more than the other. 

For example, the Educational Administrator Effectiveness Pro- 
file (Human Synergistics) offers eleven themes with a strong slant 
toward task orientation: .setting goals and objectives, planning, mak- 
ing decisions and .solving problems, managing business and fi.scal 
affairs, as.se.ssing progress, delegating responsibilities, communicat- 
ing, building and maintaining relationships, demonstrating profes- 
sional commitment, improving instruction, and developing staff. 

Conversely, the Principal Perceiver has a strong relationship- 
orientation, including themes such as developer, relator, individual- 
ized perception, stimulator, and team. 

In most cases, behavior is measured by having respondents indi- 
cate the degree to which they engage in particular behaviors. For 
example, the “communicating" cluster might include items such as: 

• tells employees what is expected of them 

• promptly communicates changes in plans 

• provides feedbtick on employee performance 

As with the measurement of traits, some instruments supplement 
the leader's self-as.scssment by asking associates to indicate how 
often they have observed these behaviors. 

Another approach to measuring behavior is the as.sessmeitt cen- 
ter. For instance, a leader may be given a simulated task (such as the 
well-known in-basket cxereise) while trained observers assess his or 
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her performance. The National Association of Secondary School 
Principals runs assessment centers that examine behaviors in such 
areas as organizing, communicating, and problem-solving. The Na- 
tional Association of Elementary School Principals offers a “Profes- 
sional Development Inventory" that asks administrators to respond to 
simulated leadership situations. 

In assessment centers, the leader's behavior is directly observed 
by trained assessors. This method may give a more accurate picture 
than the informal impressions of leaders and their associates. How- 
ever, centers ofi'ei' a rather controlled “laboratory" environment and 
may not always detect how a leader lypically behaves in a real-world 
setting. 



Situat ionnl Icvndership 

When researchers first began exploring task-orientation and rela- 
ti(.)nship-orientation, they thought that one or the other might prove to 
be more important to leadership. Despite dozens of studies, however, 
they failed to establish consistent links between particular behaviors 
and organizational outcomes. That is. some studies showed that task- 
oriented leaders were more successful in accomplishing goals while 
relationship-oriented leaders created better morale, but other studies 
showed that both types of behavior were associated with both kinds 
ol' success (Marlin Cheniers 1997). Once again, leadership recipes 
proved elusive, and some researchers speculated that leadership suc- 
cess depended on the situation; something that worked in one setting 
might fail in another. 

This notion was intuitively appealing, since it might explain 
numerous cases where leaders of proved ability are unable to repeat 
thcirsLiccess when they transferto new jobs. Forcxample, a declining 
school with a demoralized, inexperienced faculty may benefit from a 
principal who provides clear goals, firm strueture. and continual 
enthusiasm. That approach may be less successful at a thriving school 
with experienced, confident teachers w'ho resent someone trying to 
tell them hou to do their Job. 

In testing this idea, researchers have found a complex picture 
(Cheniers). I'or example, one early finding was that task-oriented 
leaders are more successful in high-control situations (with a clear 
task, motivated followers, and high authority) ami in low-control 
situations (with an unclear task, disgruntled followers, and limited 
authority). In the first case, a strong task orientation helps keep the 
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group happily on task; in the second ease, it provides at least some 
order in a chaotic situation. By contrast, relationship-oriented leaders 
seem to do better with moderate control situations, such as motivated 
followers and an unclear task (where participative decision-making 
may be productive) or disgruntled followers and a clear task (where 
personal attention may sooth the feelings of followers). 

The best-known application of this research comes from the work 
of Paul Hersey and Kenneth Blanchard (199.'^), who emphasi/.e the 
importance of the match between the leader’s behavior and follow- 
ers' “developmental readiness.” They de.scribe two broad types of 
leader behaviors: directive and .supportive. Leaders provide direction 
when they set goals, communicate expectations, and monitor results. 
They provide support by listening, encouraging, reassuring, and 
soliciting participation. Taken together, these two kinds of behavior 
lead to four leadership "styles:" high direction-low support (direct- 
ing); high direction-high support (coaching); low direction-high sup- 
port (supporting); and low direction-low support (delegating). 

Followers can he characterized by their commitment and their 
competence. Taken together, these two qualities result in four differ- 
ent developmental levels that can he matched to the four leadership 
styles. Ideally, leaders will adapt their style to suit the need of the 
workers. Thus, employees with high competence and high commit- 
ment are best led through delegating; workers with high commitment 
but little competence respond well to directing. For Hersey and 
Blanchard, there is no "one best style"; the best approach depends on 
the situation, and the best leaders are tlexible in their styles. 

In theory, tests can a.ssess this kind of Ilexibility by asking leaders 
to devise strategies to handle different kinds of situations. One test 
that does this in a direct way is Leader Behavior Analysis II (Blanchard 
Training aiul Development). Respondents are presented with twenty 
hypothetical .scenarios and asked to choose the strategy (out of four 
listed) that would best represent the approach they would take. A 
companion instrument asks peers, superiors, and subordinates to 
predict how the leader would be likely to respond. 

However. t)thers find this approach to he a little too pat. suspect- 
ing that life is messier than a few hypothetical situations on paper. In 
addition, some researchers arc skeptical of the Hcr.sey and Blanchard 
model because its validity has not been extensively studied (Cheniers). 
Few other tests attempt to measure situational appropriateness so 
directly. 
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However, many instruments do assume that leadership success 
depends on a good match between the leader’s behavior and the 
demands of the situation. For example, tests of leadership “style” are 
based on the belief that leaders should at least be aware of their 
typical approach so they can rccogni/e its advantages and disadvan- 
tages in different situations. Style generally refers to the eharacleris- 
lic ways that leaders make decisions, use power, and interact with 
others, but the specific definition can vary greatly. 

I’or example, the Myers-Briggs Type Indicator (Consulting Psy- 
chologists Press) assumes that human persoiicdity is structured along 
four dimensions, each containing two contrasting possibilities: 
intra\ ersion/extraversion, sensing/intuitive, thinking/feeling, and judg- 
ing/perceiving. These four po.ssibilities rc.sult in sixteen basic “types." 
each with a distinctive flavor and a unique way of approaching life 
(Isabel Briggs Myers and Peter Myers 1980), 

By contrast, the Life Styles fin'entory (Human Synergislics) pos- 
tulates twelve styles, each of which can be present in varying degrees: 
hiimanistie-encouraging, affiliative. approval, conventional, depen- 
dent. avoidance, oppositional, power, competitive, perfectionistic. 
achievement, and self-acluali/ing. 

Despite such differences, most style measures seem to share 
several assumptions: 

1. Style is a matter of relatively strong preferences that arc 
difficult, but not impossible, to modify. 

2. In general, no one style is preferable to (Hhers; each has 
advantages and disadvantages. For c.xample. the IJfc Styles Inventory 
notes that those with a very sti aig "oppositionar' style may be 
perceived as harshly critical; those \\ ith a very low' oppositional style 
may be .seen as weak or naive. Interpreters of the Myers-Briggs Type 
Indicator often point out the frustrations and ill feelings that can result 
when coworkers attempt to use clashing styles on the same problem 
(Robert Benfario 1991). 

Style can be measured by assessing attitudes and perceptions 
as well as behaviors. 



I I'.insh )rmol icjiiid I (vi< Icmship 

Most of the viewpoints discussed above are leader-centered, 
focused on how leaders think and act. But leadership is also a social 
interaction between two or more i)Cople. (As many observers are fond 
of putting it. a loader is someone who has followers.) In a society that 
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values fieedom and personal independence, what causes people to 
comply with the wishes of others? 

Most researchers have explained this relationship as a I'orm of 
exchange: that is. leaders ask I’or compliance from followers, but in 
return they jnovide concrete rewards such as money, recognition, and 
personal advancement. Seen this way, leadership is simply a rational 
economic transaction offering something for everyone. 

In recent years, strme observers have noted that the relationshii? 
sometimes transcends economics. Some leaders have followers who 
do more than comply or cooperate — they become enthusiastic and 
deeply committed, even when the leader has little material reward to 
offer in return. These transfor/national leaders build a sense of 
community, use evocative, emotionally charged language, and frame 
issues in moral terms (Bass). 

Although this is sometimes called charismatic leadership, seem- 
ingly implying a return to Carlyle's brand of heroic leadership, the 
underlying issue is not personality but the way that leaders use 
authority. Whereas transactional leaders aim for compliance by offer- 
ing concrete rewards to followers, I'ansformational leaders aim for 
commitment by convincing followers that the organization is an 
extension of their identity. 

In more concrete terms, transformational leaders use four tools to 
get results (Bernard Bass and Bruce Avolio 1994). 

• Individmilized attention recognizes the differences among fol- 
lowers and allows i'or their developmental needs. 

• Intellectual stimulation turns the attention of followers to 
goals, aspirations, and new ways of doing things. 

• Inspirational motivation is the w'ay that transformational lead- 
ers help followers find meaning in their work. 

• Idealized influence occurs when the leader serves as a living 
example and role model for follow'crs. 

Transl’ormalional leadership can be measured by tapping the 
perceptions of leaders and followers, hor example, the Leadership 
Practices Inventory (.losscy-Bas.s/Pfeiffer) shows a transformational 
orientation when it seeks to measure categories such as challenging 
the process, inspiring a shared vision, enabling others to act. model- 
ing the way, and encouraging the heart. 
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I’lic' Linknown l-C'tUlcM 

Ifroscairlicrs have nol yet eompletely pul Uiiiellicr llic leai.lei'sliip 
pu//le. it may ho heeaii.se a lew pieces are missing. 

I'irsi. leadership theories - and leadership lesls — are alv\'ays based 
on (he leaders we have. IViosl views of leadership were formLilated in 
a time when the standard image of leaders was white and male. As 
women and minorities enter leadership roles in increasing numhers. 
‘‘lypieal“ leader behavior may change — along with our sense of the 
possibilities, 

At the moment, there is no eonelusive e\idenee that w<!men or 
minorities develop distinetise styles tliat tlilTer from traditional pat- 
terns (Cdiemers; Klenke). However, it may he that female and minor- 
ity leaders ha\e felt a ncetl to ''10 in" vvith prevailing leadership 
models; as their lumihers increase, they may I'eel I'reerio develop new 
styles and strategies. Thus, test users .should he alert to the possibility 
that eurrent instruments do not I'lilly refleet what leadership could be. 
b'or example. Klenke suggests that some tests have relied excessively 
on foreed-ehoice opposites that limit response to a narrow range of 
I'lossihilities. 

Another area that has reeei\ed limited attention is \alues. In 
leeeiit years, leadership gurus have become fond of saying. "Leaders 
should spend less time worrying about doing things right and more 
lime worrying about doing the right thing " Warren Bennis ( I9H4). 
altera lil'eiime of siiKlying leadership, says (hat the essential ingredi- 
ents of leadership are our "best qualities": integrity, dedication, 
magnanimity, humility, openness, and creativity. 

Although values have not been e,\lensi\ ely studied, there is 
ample aneedoial evidence that followers respond well to qualities 
such as honesty and integrity. Kou/es and Posner, after siir\'eying 
thousands of employees, iiave found that "honesty" is the main 
t|ualily that followers want to see in leaders. In addition, studies point 
out that transformational leaders get their results by appealing to the 
values olTheir followers. 

While some tests make an effort to measure core values such as 
honesty, integrity . and respect, none adtlress a related question; Does 
the conu’iu of the leader's beliefs make a difference? After all. a 
transformational leader like Marlin Luther King. .Ir.. is remembered 
nol just for his qualities of dedication, integrity, and courage, but for 
uinil he stood for. If King had advocated a "go-slow" approach to 
civil rights, or had favored violent resistance, would he have aecom- 
[dished as nuieh? 
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The same c|ucsiion can be asked of scliool leaders. Thomas 
Sergiovanni has recently suggested that dTeclive principals view 
learning in conslmclis ist terms. Is this the case, or should principals 
follow the advice of the previous decade by providing highly struc- 
tured, goal-oriented learning activities? Or does the answer vary from 
one situation to another? Research holds no answers, and leadership 
tests make no attempt to identify substantive values, much less 
suggest that a particular set of values is preferable. 

lanally, no matter how eloquent or provocative the discussion or 
theory, empirical knowledge about leadership is limited by the lack of 
consensus on certain key questions, each of which is an.swcred 
dilTerently by different studies: 

1 . Qtu’.siions oj'dcfinilion. Who is a leader? Is it someone who has 
formal authority? .Someone who has technical competence? Someone 
who has persuasive ability? Is there a difference (as many claim) 
betw een 'ieaders" and "managers?" If so. how do we tell the differ- 
ence? If a test says it has been validated on a population ol' managers, 
can we assume it will give us a portrait of leadership? 

2. Questions of effectiveness. Is there ti difference betw'cen sue- 
eessful and unsuccessful leaders? Studies of leadership have often 
built (heir eonelusions around an identified population of leaders 
without asking whetherthe.se leaders w'erc all successful. l,eadcrship 
tests may also fail to make this distinction, 

.T Questions of context. To what e.xtcnt can results from a study 
be generali/ed to a larger population? Not all organizations are alike: 
w hat's required for success in one arena may be irrelevaiit in another. 
We can easily imagine, for example, that successful leadership in the 
inieroprncesstir business requires boldness, imagination, and an abil- 
ity to spot trends before they have fully emerged. Those same quali- 
ties are probably less useful in running a nuclear power plant. This is 
a signil'ieant question for .school Icttders. since many of (he available 
tests h.ive been de\eloped in a corporate environment. 

4. Questions of bias. Many leadership studies (and ninst leader- 
ship tests) are based not on controlled observation of behavior but on 
pen eptioits of behavior. Asked to rate their own behavior, leaders 
(like everyone else) tnay see themselves in a more positive light thtin 
actual obsersation would reveal (Bass). For this reason, leaders' 
perceptions are often cross-cheeked by tapping (he perceptions of 
those w ho know (hem. 

However, even fair-niinded obseiwcrs do not alw ays .see clearly. 
C’hemers notes a persistent problem that comes from the "romance of 
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leadership” — the belief that organizational outcomes are always due 
to the actions of a heroic leader. When things are going well, or 
employees are happy, they are likely to attribute it to the actions of the 
leader. As a result, when surveyed, they may “.see” positive behaviors 
that have not actually occurred. In short, leaders' actual behavior is 
obscured by the glare from their haloes. (Of course, if the organiza- 
tion is going through hard times, the reverse may apply.) 

These questions do not invalidate existing leadership studies or 
the instruments that result from them. But they do suggest that tests of 
leadership should always be considered provisional or tentative. 



The Nature of School Leac:lership 

The views of leadership di.scussed in the preceding section have 
originated in the corporate world (or. to a lesser degree, in politics). 
Can we safely assume that .school leadership follows the .same rules? 

Educational administrators have often been quick to take their 
cues from business. For example. Total Quality Management — a 
process designed to reduce manufacturing defects — took just a year 
or two to emerge in education as the Total Quality School. 

Yet the differences between business and education arc signifi- 
cant: 

• Schools are not profit-oriented, so there is no single standard 
of success (test .scores arc highly ambiguous). 

• School leaders operate in a highly public domain, knowing 
that every action will be .scrutinized, and every memo may 
become a public record. 

• Schools arc political institutions trying to please an increas- 
ingly diverse and contentious society; consensu.s — or even the 
appearance of consensus^ — is difficult to achieve. 

• .Schools have a near monopoly, meaning the competiti\e spirit 
that drives many businesses is lacking. 

Although school superintendents arc often compared to CEOs, 
it's hard to imagine a private-sector executive with a similar task: 
managing a well-educated group of professionals while simulta- 
neously cajoling and soothing a lay board and ever more demanding 
public. 

Thomas Sergiovanni (1996) argues that schools are an inherently 
moral enterprise requiring a very different approach than that used by 
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business. “Wholesale borrowing of theories from other fields has 
resulted in a characterless literature of educational administration.” 
he writes. 

Our quest for character does not begin with some other 
field’s models, but with our own visions of what we want for 
the parents and students we serve, of how we want to work 
together to achieve these purposes, and af what we need to do 
for purposes and beliefs to be embodied in school practice. 

Sergiovanni argues that an adequate theory of educational leader- 
ship should be aesthetically pleasing, using language that is both 
appropriate and appealing. (For example, gardening is a more appro- 
priate metaphor for teaching than Total Quality Management.) It 
should place moral authority at the center, emphasizing the mutual 
connections and obligations that link members of the school commu- 
nity. It .should emphasize the school as a producer, not just a transmit- 
ter, of knowledge. 

In practical terms, this view demands that principals have skills 
in nine areas; 

• purposing (transforming shared visions into a moral covenant) 

• maintaining harmony 

• institutionalizing values 

• motivating . 

• managing 

• explaining 

• enabling (removing obstacles to participation) 

• modeling 

• supervising 

While some of these skills can be found in various leadership 
instruments, no test has yet been built around them or, for that matter, 
around any comprehensive theory of school leadership. 

William CFrccnfield (1986) advances a similar view, noting that 
schools are normative institutions, gaining employee commitment 
through persuasion and appeals to common values rather than coer- 
cion. Principals have some power to reward and punish, but teachers 
who are so inclined can easily evade the wishes of principals. 

Greenfield suggests that leadership in this setting requires five 
sets of skills: 
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• Managerial (coordinating, direcling. and monitoring school 
operations) 

• Instructional (oversecinsi the school's core activities of teach- 
ina and learnine) 

• Social (face-to-face inleractitins with students, teachers, par- 
ents. and community members) 

• Political (negotiating the inevitable clashes among the mul- 
tiple agendas of meinbers of the school community 

• Moral (determining what policies and practices are desirable 
and consistent with the school's purpose) 

b'inally. there are those who sec school leadership as a rrafi. 
Arthur Blumberg ( 1 989) defines rrafi as "the idiosyncratic use of self 
to make prudent decisions concerning problematic situations in school 
life." Craft includes standard administrative skills, but also involves a 
comprehensive, detailed knowledge of a particular school — what 
Blumberg calls "a nose for things." He quotes one principal who 
seemed to exemplify "management by walking around"; 

I can sense v\hen things are going right or wrong on any 
particular day. When I walk around. 1 listen for the level of 
noise in the building and I look for the amount of debris or 
litter. If it seems more than noi mal. it's a signal that some 
vandalism may be creeping in. 

How d()cs one assess this skill'.' While a leadership test could (ell 
rather easily whether princi[ials spend time in the hallways, it would 
be much more difficult to determine whether they were managing or 
just walking around. Administrative craft seems to involve a greal 
deal of /rav;/ knowledge of a kind that \\x)uld be difficult for a national 
test to assess. 

In general, the measurement of school leadership (as opposed to 
other kinds of leadership) is relatively rare. Most tests come from the 
corporate world, and while they can offer excellent insights into 
school leadership, they should he used with care. 

More generally, however, we can say that no test (even one 
designed specifically for school environments) will offer a coiniu'c- 
hensivc picture of leadership capability, for now. at least, school 
officials who are looking for a simple off-the-shelf solution to leader- 
ship assessment will be disappointed. 
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Leadership Qualities 

The first part of this chapter examined some theoretical views of 
leadership and how they are reflected in leadership tests. This section 
looks more coneretely at some of the specific traits, behaviors, and 
attitudes that frequently show up on leadership instruments. 'Phis 
discussion is not all-inclusive, but demonstrates in practical ways the 
form that these qualities take on tests. 



Com m u n i c:at i n jJt 

Virtually everyone agrees that communication, though it is de- 
fined in a variety of ways, is essential for leaders. Sometimes commu- 
nication refers to the leader's ability to provide information and 
directions in a timely way: other times it involves the ability to 
establish and maintain mutual dialogue. Some sample test items 
might look like this: 

• I never end a meeting until 1 make sure that everyone under- 
stands the decision. 

• Before any decision is made. 1 st)licit opinions from tho.se who 
will be affected. 

• 1 maintain an open-door policy. 

• 1 make an effort to return all phone calls on the day 1 iecei\e 
them. 

• 1 frequently walk around the building so I can interact with 
people 1 might not otherwise .sec 



F“; St a lo I i sh i n Ro I a t ic j n sh i ps 

Leadership is a people-intensive business, and many tests at- 
tempt to find out how effectively leaders establish and maintain 
personal relationships. .Some sample items: 

• 1 take a personal interest in my employees. 

• I make sure that employee achievemenis are recogni/ed. 

• 1 enjoy being around people. 

• I frequently chat w ith i'»cople about things that have nothing to 
do with work. 






38 MEASURING LEADERSHIP 



• When 1 have a conflict with others. 1 always listen to their 
point of view before I explain my position. 



Cjoal-Seltin^ cmd Planning 

Most people believe a major leader role is providing the organi- 
zation with a clear sense of direction and taking the steps to ensure 
that the destination is reached. Some sample items: 

• At the beginning of each new project 1 make sure that every- 
one understands the goals. 

• I make sure that each goal we set will get the necessary 
resources to carry it out. 

• 1 frequently talk about our goals so that everyone understands 
their importance. 

• At the end of each year 1 update our goals to ensure they are 
still relevant. 

• I e.stablish careful timelines for each goal. 

Empowori ng» Others 

Recent views of leadership have emphasized the leader’s role as 
a facilitator: someone who leads through others. Some sample items: 

• 1 allow others to work things out for themselves even when I 
could do it more quickly myself. 

• 1 provide resources and encouragement for employees to up- 
grade their skills. 

• 1 frequently ask staff members for their views. 

• At meetings I make a deliberate effort to .sit back and listen 
rather than leading the discussion. 

• Once 1 establish a committee to accomplish a task. 1 let them 
do their work. 



Inspirinjg 

The recent emphasis on transformational leadership 1ms created 
an interest in leaders who use their moral authority to inspire and 
motivate others. Some possible items: 
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• I frequently talk about our vision for the future. 

• 1 like to tell .stories about people who have really lived up to the 
ideals of this organization. 

• 1 make an effort to hire people whose values are aligned with 
our mission. 

• 1 demand that employees live up to the ideals of this organiza- 
tion. 

• I make sure we celebrate the accomplishments that lead us 
closer to our vision. 



Ethics 

James Kou/.es and Barry Posner ( 1993) note that the leadership 
quality most often valued by subordinates is honesty. Leaders who 
conduct themselves ethically, recognizing and acting on their respon- 
sibility to others, will gain credibility and moral authority. Some 
sample items: 

• 1 am willing to admit it when I've made a mistake. 

• When I’ve given my word, people know I'll follow through. 

• I don't ask my subordinates to do anything that I’m not willing 
to do myself. 

• I'm willing to take public criticism in order to uphold our 
mission. 

• 1 practice what I preach. 



Style 

Style is a broad concept that can include many of the behaviors 
and attitudes already di.scussed. Most often, however, it focu.ses on 
the characteristic ways that people solve problems and interact with 
the world around them. 

• I would rather deal in concrete data than in theorizing about 
possibilities that might never occur. 

• When faced with a dilTicult decision, I listen to my heart rather 
than my head. 

• Interacting with large numbers of people keeps me energized 
and interested. 
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• I would ralher keep my independence than he indebted to 
others. 

• I'd rather complete one task at a time instead of juggling 
several at once. 



Pe^rscinal Traits 

Although the trait explanation of leadership has lost favor, theo- 
reticians and test makers still see certain personal qualities as playing 
a significant role. For example; 

• When things get busy. I'm able to find the extra energy to keep 
going. 

• I don't lose my temper or take out my frustrations on others, 

• I take a lot of work home with me in the evening or over 
weekends. 

• Tm always reading the latest research to find new ideas I can 
use. 

• I'm \ ery hard on myself. 

These examples give the I'lavorof many paper-and-pencil as.sess- 
ments. and also reveal .some of their advantages and disadvantages. 
The items are usually simple and can be answered without a great 
deal of analysis, particularly when they focus on concrete behaviors. 
A fairly' compelling portrait can be created in a short time. 

However, such items can be highly subjective: words such as 
‘■frequently." “usually." or “a lot" leave considerable room for inter- 
pretation. In addition, items of this type do not provide reliable 
measurement of actual skill or effectiveness. Thus, results will be 
most Li.seful v\ hen used as part of a comprehensive process of analy- 
sis. reflection, and goal-retting. (Sec chapter 4.) 

A somew'hat more direct measurement of leadership capabilits 
comes I'rom asking leaders to respond to simulated problems. F'or 
example, an inbasket cxerci.se might provide the following data; 

.Siltine at your desk at 7;.^() Tuesdiiv mornimi. vou find the 

followiim ilems ou vcnir lo-d(^ list: 

I. Prepare an agenda for the curriculum committee meeting 

on Thursday. 
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2. Check on a report ol' increasing student rovvdiness at bus 
unloading. 

.T. Meet with Sylvia LeMahieu, a third-grade teacher who has 
frequently arrived late to school this year. 

4. Consult with architect about this summer's renovation 
project. 

5. Prepare for meeting witli unit heads to discuss a mandated 
budget reduction of 10 percent. 

6. Messages on your answering machine: 

— Arlene Johanson, PTA president, wants to di.scuss the 
reading carnival scheduled in two weeks. 

— John Barrett, the superintendent, wants you to call. 

— Ed Arnett, a reporter for the local paper, wants a comment 
on your school’s recent decline in test scores. 

— Myrl Halverson, owner of the bus company, wants to dis- 
cuss a possible route change. 

— Mrs. Cantor, parent of a sixth grader, is up.set about the 
amount of homework he has been receiving. 

— Leann Alvah, candy company representative, wants to 
discuss a po.ssible fund-raising opportunity. 

In responding to this agenda, leaders will reveal a great deal 
about their thought processes and their ability to prioritize and re- 
solve typical administrative problems. 

Alternatively, leaders might be given a hypothetical scenario and 
asked to explain what they would do and why: 

In the two years that you have been principal of Glen River 
High School, you have received a growing number of com- 
plaints about Ed Halley, a xeteran English teacher. The 
complaints arc always the same: poor discipline, uninspired 
lessons, and a failure to challenge students. 

You know that Halley was once considered a competent, 
dedicated tctichcr. Indeed, his dedication has never been in 
doubt; he often arrives at school early, is seldom absent, and 
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has often been a moderating voice among more militant 
teachers. Your observations of Halley’s classroom have con- 
firmed many of the complaints. Halley often seems to be 
going through the motions; his lessons are flat and lifeless, 
consisting mo.stly of teacher monologue. While student be- 
havior is not extreme, there is far too much restlessness, 
inattention, and chatter to permit much learning. Halley seems 
to ignore the lack of student attention; when he does admon- 
ish students, they feel free to ignore him. On at least two 
occasions, you have seen students talk him into canceling a 
homework assignment. 

You have raised these issues in postevaluation conferences, 
but Halley denies there is a serious problem. He concedes 
that students are not wholly attentive, but blames it on televi- 
sion and lack of discipline at home: “I don't like it either,” he 
says, “but you can't fight a whole society." At 55, he admits 
he “may have lost a step or two,” but pointedly adds. “Aging 
isn't a crime.” 

1 . In resolving this dilemma, what arc the key factors you 
would need to consider? 

2. What additional information would you need before mak- 
ing a decision? 

?>. Ba.sed on the information provided, what action would you 
take? 

Items such as these provide good insight into a leader's ability to 
recognize critical elements in a problem and to make a well-reasoned 
decision. Obviously, there is no single “right” answer, but test takers 
would be e.'.pected to address the key issues. While this type of 
question pnrvidcs information not available through simple self- 
inventories. it also requires considerably more time to take and to 
score, and the need for trained assessors makes such tests rather 
expensive. 



The ISIeed to Choose Wisely 

As this chapter has demonstrated, experts are i'ar from a consen- 
sus on the nature and demands of leadership, and leadership assess- 
ments reflect these differences of opinion. The diversity of tc.st 
instruments provides schools with both danger and opportunity. The 
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danger is assuming that any lest of leadership will be suitable for a 
particular school; the opportunity is that in the wide range of choices, 
school officials are likely to find a test that suits their specific needs. 
Chapter 3 discusses the steps rec]uired to make a wise choice. 
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Selecting the Best 
Instrument 

Ifthc world oriea(Jcrshi|) theory is nuilliraceled ;md ineoiisisleni, so 
is the world of' leadership testing. Organi/.atioiis can choose from 
dozens, perhaps hundreds, of instruments designed to help select or 
develop leaders. 

.School districts looking fen- "the one right test” are likely to be 
disappointed. No instrument is perfect (especially since relatively 
few have been specifically designed for school settings), yet more 
than one may be acceptable. Making the right choice rec|uircs careful 
attention not only to the instrument, but to the needs of the district 

Thus, buying a lest off the shelf bectiuse it stiys "leadership” is a 
bit like buying a mail-order suit because it has three buttons and a ne;it 
little pinstripe; you’ll get what you paid for. but it won't necessarily 
fit. The ec'iisequences of a poor choice can be significant, ranging 
from wasted lime and money to poor personnel decisions. This 
chapter outlines ;i decision-making process that increases the chances 
of an appropriate choice. 



Step 1 : Kno-w "Vour Purpose 

.Schools may want lo measure letideiship for .several distinct 
purposes, etich of which will raise a particuhir set ol issues. 

Si’lcaioii. As noted in chapter 1, leadership tests c;in enhance 
iraditioiKil methods of selecting leaders, such as interviews. How- 
e\er, using tests for selection brings some special responsihilities. 
Hiring is a high-stakes decision; districts may incur considerable 
e.spense and aggnivation from a poor choice. Using tests for selection 
requires careful job analysis to determine what qualities and skills are 
desired for a gi\cn position. Candidates have a lot at stake as well. 
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and the possibility of discrimination raises both ethical and legal 
issues. Few of the instruments discussed in this hook have been 
designed for selection purposes. 

Evaluation. Using leadership tests to evaluate performance is 
highly controversial, especially when compensation or career ad- 
vancement will be affected (Maxine Dalton 1998), At best, tests are 
an indirect measure of Ictidership. always one step remtn'ed from the 
arenii of action. Ideally, leaders who have been employed by a district 
for any length of time should be rated by on-the-job performance, not 
by the refracted images that come from tes;s. 

Dalton notes that linkina test results with concrete rewards \io- 
hues the conditions of “psychological safely'' needed for productive 
feedback. The greater the stress, the less likely that leaders will be 
able to accept and learn from feedback that clashes with their self- 
image. In addition, tests relying on feedback from peers and subordi- 
nates may produce inticeurate results because of reluctance to do 
harm to colleagues, 

Ellen Van Veksor (1998) suggests that in organizations with a 
well-established tradition of using tests for self-development, where 
employees are comfortable and experienced with the feedback pro- 
cess. it may be possible to use tc.sts for appraisal. However, she 
suggests that when te.sting is being introduced for the first time, 
linking it to formal evaluation would be a mistake. 

At the same time, leadership instruments may appropriately play 
a role in the overall as.sessment procc.ss. Administrator evaluation 
often includes self-assessment and goal-setting, and the right instru- 
ment can enrich the reflective process, 'fo do this effectively, districts 
must be sure that their evaluation process establishes a link between 
on-the-job performance and the qualities measured by the instrument. 

At a minimum, districts initiating a feedback process should use 
great clarity in explaining the relationship between the te.sting pro- 
cess and formal appraisal. In particular, leaders should know what 
limits, if any. are being placed on anonymity and confidentiality (Van 
Velsor). None of the instruments discussed in this hook have been 
specifically designed for on-thefoh evaluation. 

Professional Development. Most often, leadership tests are used 
to stimulate professional development. A well-chosen instrument 
may give leaders new insights into their own behaviors, making them 
conscious of strengths and weakne.sses. In such cases, .schools must 
ensure that the chosen instrument is designed to promote reflection 
and provides followup and support for the leader's self-analysis. 
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Most of the instruments described in this hook are designed for 
professional development. 



SJep 2: Develop a Local Definition of 
Leadership 

As chapter 2 made clear, definitions of leadership cover a wide 
range of personal qualities and skills, and each leadership instrument 
rellects a particular set of assumptions. To make an appropriate 
match, districts must have a clear conception of how they define 
leadership at the local level. That is, what particular qualities and 
skills are most important in this district at this time? 

In many cases, districts have not given much explicit thought to 
defining leadership, but the process does not require starling from 
scratch. Helpful clues can be found in the leadership standards devel- 
oped by professional associations as well as within the district itself. 

A good starling point is to consider professional consensus on 
leadership essentials. In rceent years, groups such as the National 
Policy Board for Educational Administration, the National Associa- 
tion of Secondary School Principals, the National Association of 
Elementary School Principals, and the American A.s.sociation of 
School Administrators have developed standards to guide the prepa- 
ration of school leaders, and they have generated lists of key school- 
leadership traits. 

In 1997. the Interstate School Leaders Licensure Consortium, a 
collaborative effort among school leadership organizations and a 
number ol' states, released a comprehensive set of standards that will 
be used to guide administrator-preparation programs. The standards 
say, "A school administrator is an educational leader who promotes 
the success of all students by" doing the following: 

• facilitating the development, articulation, implementation, and 
stewardship of a vision of learning that is shared and sup- 
ported by the school community 

• atlvocaling, nurturing, and sustaining a school culture and 
instructional program conducive to student learning and staff 
instructional growth 

• ensuring management of the organization, operations, and 
resources, for a safe, efficient, and effective learning environ- 
ment 
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• L'ollaboraling with families and comimmily members, respond- 
ing to diverse community interests and needs, and mobilizing 
community resources 

• acting with integrity, fairness, and in an ethical manner 

• understanding, responding to, and induencing the larger po- 
litical, social, economic, legal, and cultural context 

The standards are accompanied by specific indicators. For ex- 
ample. the first standard includes knowledge indicators such as un- 
derstanding "the pi'inciplcs of developing and implementing strategic 
plans." '‘sy.stems theory.” and "learning goals in a pluralistic society." 
I..eadcrs should also be committed to such things as "the educability 
of all." "continuous school improvement.” and "a willingness to 
continuously examine one's own assumptions, beliefs, and prac- 
tices." Finally, the standards must residt in actions, such as these 
pertaining to the implementation of a sehool's vision: 

• Progress toward the \ ision and mission is communicated to all 
stakeholders. 

• The core beliefs of the school vision are modeled for all 
stakeholders. 

• Barriers to aehicn ing the vision are identified, clarified, ;ind 
addressed. 

Collectively, these standards provide a comprehensive and cred- 
ible foundation for leadership assessment. In fact, they provide the 
basis for a test developed by Hducational Testing Service that is 
already being used in several stales as a licensure requirement for 
new principals. 

Districts doing their own ;issessments can draw on whichever 
sectiems of the standards seem most relevant to their current needs. 
Determining those needs takes some effort, but clues can be found in 
several .sources. 

1 . Jul) descriptions. Most districts have some sort of job descrip- 
tions for leadership positions. Although the.se are often rather generic 
and uninformative, they can be transformed into focused questions 
about current leadership needs. F\)r example, one of the described 
duties for a principal may be "to coordinate instructional improve- 
ment efforts." Given the school's history and current status, what sort 
of leadership is rcqtiired? Are teachers experienced and confident, 
needing a lacilitator more than a director, or do (hey require forceful 
leadership to set a direction'.’ What other skills and qualities are 
important in carrying out this responsibility ? 
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2 . Analysis of leadership hisiory in the distriet. Every district can 
recall examples of leadership that failed (perhaps spectacularly) as 
well as leadership that was highly successful. What was behind the 
failures? Could they be attributed to the lack of certain key character- 
istics? What qualities, skills, or attitudes do the successful leaders 
seem tii share? 

.T. Aiudysis of local conditions. Where are the curretil controver- 
sies. sore spots, and hot buttons in the district? What are the distriet's 
most urgent needs? What kinds of leaders are most likely to inaneu- 

their way through the current situation? For example, if relations 
with teachers or parents aie strained, distriets may want to give 
special attention to interpersonal skills. 

4 . Vision. At times, districts may not want someone who "fits in" 
w ith the status quo; instead they want simieone who can take the 
school in dramatic new directions. If the district or .school has a 
clearly staled vision, this will often suggest the kind of leadership 
required. An added benefit is that assessing leaders on these visionary 
qualities will send an important message that the district is .serious 
about them. 

.^. Individiud scif-aiuilysis. Even when a districtwide con.sensus 
1)11 the nature of leadership already exists, each administrator devel- 
ops his or her skills in a highly individiuilizcd manner. Every leader, 
at a given point in time, has a unique collection of technical skills and 
personal qualities— strong in some areas, weak in some areas, and 
nonexistent in still others. Each leader may need to know something 
different that a one-size-fits-all approach cannot provide. Eor ex- 
ample. if a letuler is experiencing frustration with interpersonal con- 
flict. an instrument thtil casts light on that issue would he especially 
useful. 

Most leadership instruments arc based on the assumption that 
letiders are autonomous professionals who must pla_\ an active role in 
the assessment process. Their imolvemcnt should bo solicited at the 
beginning, not after an instrument has been chosen. Table I displays 
a series of questions that will thaw out some of the issues that should 
be included on tin assessment. 



Step ,'i: Locate Possible Instiruments 

At one lime, leailorship instruments were difficult to locale and 
examine, hut .se\cr;il sources now olTer centrali/.ed listings, cither 
published or online. Most \ciulors will also proviilc examination 
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Leadership Self-Analysis 

1 . What leadership tasks have provided the greatest challenge 
for you in your current position? Why? 

2. What skills have been the most iisefiu to you in your current 
position? 

3. What personal qualities have been most useful to you in 
your current position? 

4. If you were hiring a replacement for youi position, what 
skills and/or qualities would you look for? 

5. What skills could you develop that would help you better 
meet the demands of your cunent job? 

6. What skills could you develop that would best help your 
iong-term development as a leader? 

7. What would you most like to know about yourself as a 
leader? 



copies or detailed descriptions of their tests. The instruments de- 
scribed in chapter 5 can provide a starting point, but prospective test 
users should check other sources as w'ell. 

One of the most convenient sources is the test-locator website 
maintained by the ERIC Clearinghouse on Assessment and Evalua- 
tion (http://cricae.net). The database provides quick acce.ss to infor- 
mation on more than 10,000 in.struments of various types, including 
many on leadership. For each test there is a brief descriptive abstract 
and the publisher's address. In addition, the site can locate published 
reviews of some tests, and it also has a section providing guidelines 
for choosing-instruments. 

Another source is the leadership-education .source book pub- 
lished by the Center for Creative Leadership (Frank Erceman and 
colleagues 1996). The book contains brief descriptions of seventy- 
five ciMiinionly used leadership tests, including information on target 
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audiences, administration procedures, and comments on validity and 
reliability. Vendor addresses are provided. 

Information on the assessments conducted by the American As- 
■sociation of School Administrators, the National Association of Sec- 
ondary School Principals, and the National Association of Elemen- 
tary School Principals can be found by contacting those organiza- 
tions. 



Step 4: Determine the Suitability of 
Various Tests for Your Nleeds 

The synoptic descriptions found in the literature can screen out 
many tests that are clearly inappropriate, but the final choice depends 
on aclo.se examination of the instruments and supporting information 
provided by vendors. Three questions are particularly important: 

1. What are the intended uses of the instrument? Test-makers 
design their in.struments to fill a need, and the content, inteipretation, 
and follow-through activities are tailored to fit that purpose. Most of 
today's commercially available leadership tests are designed for 
professional development, which means that their use for selection 
and evaluation is at least que.stionable, if not inappropriate. 

2. Who is the target audience? Tests are u.sually designed with a 
particular audience in mind, and scoring is often based on compari- 
.sons within that target group. Most leadership instruments have been 
developed in and for a corporate environment. This does not auto- 
matically invalidate their use in school .settings, since some leader- 
ship qualities undoubtedly cross occupational lines. However, even 
seemingly “generic" leadership qualities can differ from one setting 
to another. For example, communication with peers and subordinates 
in a corporate environment may be very different from communica- 
tion with teachers and parents in a school setting. Because of the 
scarcity of education-specific in.struments. this issue should be care- 
fully considered. 

3. Does the content of the test address the leadership issues of 
concern to the district ? This is the essence of the analysis, one that 
can he approached through a two-part process. The first step is to 
develop. a table that .specifies the content requirements and then to 
check off which imstruments address those issues (sec table 2). 

Second, the most promising instruments should be read to see 
w hether the questions are actually congruent with llie district’s defi- 
nitions. A term like "communication" covers a lot of ground; the 
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(Jisirict may be inierested in inteipersonal relationships, while the 
inslriimonl focuses on the dissemination of information. 



Step 5: Establish the Credibility of the 
Instrument 

Nothing undermines assessment faster than the perception that 
the process is inaccurate, irrelevant, or unfair. Anyone contemplating 
the use of a particular instrument should have solid evidence that the 
instrument is statistically sound and capable of providing the infor- 
mation desired — and that it will be seen that way by participants. 

The standard statistical measures of soundness are reliability and 
validity. While test users will seldom need (or be able) to get involved 
with sophisticated calculations, they should be able to evaluate the 
information provided by test publishers about test characteristics. 



Validity 

Validity is the bedrock of a test's soundness, offering assurance 
that the instrument can deliver on its promises (American Educa- 
tional Research Association and others IVS.'i). Statisticians htivc 
developed numerous ways of testing validity, but two common-sense 
questions will get to the heart of things: 

1. Docs the instrument assess the qualities it claims to? Would ti 
reasonable person agree that the items in this assessment reflect the 
particular dimensions of leadership th;tt we're interested in? If the 
answer is "yes," the assessment will be seen as credible. 

2. Is there evidence that performance on the as.sessmcnt corre- 
lates with performance on the job ? That is, do high scorers perform 
better on the Job than low scorers? Not e\ ery instrument has been 
validated in this way, and even w'hen the information is provided it 
has to be interpreted carefully. For example, results of tests de\ el- 
oped in a corportttc environment arc not automatically transferable to 
school settings. Over time, however, you should be able to determine 
thtti a ptirticLilar instrument is a good predictor of leadership success 
in your district. 

These questions can be answered in a variety of ways. In answer- 
ing the first question (Does (he instrument measure the qualities it 
claims (o?i. we can attempt to gauge ihc instrimienrs face v alidity, 
content validity, and construct validity, then seek to determine its 
predictive validity. 
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a. Face validity. Face validity does not involve any technical 
tests: it simply means that a reasonably well-informed person would 
agree that the test appears to measure leadership. Obviously, this 
kind of impressionistic judgment offers no objective assurances, but 
if the answer is “yes.” the test is likely to have credibility among those 
who use it. . 

b. Content validity. Like face validity, content validity rehects a 
judgment about how well a test covers a particular domain. However, 
the judgment is more formal; for example, test-makers may ask 
leadership experts to indicate how well the test measures essential 
leadership qualities. 

c. Construct validity. A construct is a theoretical quality that is 
assumed to exist but cannot be directly measured. Leadership is a 
prime example. We observe differences in the ways that leaders act or 
in the results they get, and wc infer that there must be some quality 
that accounts for it. 

A test with good construct validity is one that is in accord with a 
particular theory of leadership. For example, the Leadership Prac- 
tices Inventory (Jossey-Bass/Pfeiffei) seeks to measure exemplary 
leadership rather than routine management skills; the construct is 
centered on the way that ordinary people accomplish extraordinary 
things. Re.search by the instrument's authors found that the cs.sential 
qualities of exemplary leaders were covered by the categories “chal- 
lenging the process.” "inspiring a shared vision," "enabling others to 
act.” "modeling the way,” and "encouraging the heai't.” I'he Leader- 
ship Practices Inventory would have good construct validity to the 
degree that the test items reflected these categories. 

Note, however, that construct validity is not universal across 
instruments. Another test may have low construct validity in relation 
to the theory underlying the Leadership Practices Inventory, but have 
high construct validity for a different leadership theory. In general, 
tests are considered sounder if they show construet \ alidity in relation 
to .some theory; this indicates that the results are likely to be coherent 
and understandable, rather than a random collection of scores. For 
districts that have a well-articulated leadership theory of their own. 
the best instrument would be one that has high construct validity for 
that theory. 

d. Predictive validity. While the above types of validity offer 
some a.ssurance of credibility, most people are even more impressed 
by evidence that the instrument w'orks in the real world. If high 
scorers on the lest turn out to be effective leaders in everyelay terms. 
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then we can use the instrument to predict success rather than simply 
waiting to see what happens. 

Predictive validity is most often measured by correlating the test 
to some kind of external job-related criteria. For example, in the 
business world predictive validity is sometimes measured by admin- 
i.stering a leadership test to a group of would-be executives and then 
returning in five years to see how high they have risen in the organi- 
zation. Or, we could survey their subordinates to learn how they are 
perceived as leaders. (We could also do similar surveys of their 
current performance as leaders — a measure known as concurrent 
validity.) 

While studies of predictive and concument validity yield hard 
numbers, those numbers are only as good as the external criterion 
being used. We might speculate, for example, that promotions are 
sometimes influenced by political connections or sheer luck. Surveys 
of subordinate perceptions may ofl’er only a limited picture of leader- 
ship effectiveness. Thus, no matter how strong the validity .scores 
provided by publishers, users must still make the final judgment that 
a test rellects the desired traits. As the authors of the Standards for 
Educational and Psychological Testing point out, 'it is incoiTect to 
use the unqualified phrase 'the validity of the test.' No test is valid for 
all purposes or in all situations" (American Educational Research 
Association and others 1985). 



Reliability 

The other statistical check of an instrument's soundness is reli- 
ability. which simply measures the likelihood that a test score is 
typical of the person achieving it. That is. would he or she achieve a 
similar score if the test were taken again? If not — if scores were to 
fluctuate dramatically from one time to the next — the results w'ould 
be of little value. 

Reliability can suffer for a number of reasons. The most obvious 
(and the hardest to control) arc the condition and attitude of the test- 
taker, Someone who is mentally fatigued, depres.scd, distracted, or 
unmotiv ated is likely to produce a score that fails to reflect his or her 
true capabilities. Test publishers have no way of measuring the 
degree to which this has occurred in a particulai ease. It is best 
controlled at the time of the test, by establishing conditions that allow 
subjects to perform at their best. Motivation is especially important; if 
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icst-uikers see ihe test as iirelcvani or inappropriate, they may not 
give it their full attention. 

One way to raise reliability is to make the test long enough that it 
asks multiple questions on the same topic. A single question may be 
answered inaccurately for any number of reasons, such as momentary 
inattention, ambiguity, or stress; when a test asks multiple questions 
on a particular topic, the chance of an accurate answ'cr rises. 

Subjectivity also threatens reliability. Tests that require scorers 
to use personal judgment in evaluating the answers may result in 
inconsistent scoring. For this reason tests requiring subjective judg- 
ments usually provide training or e\cn certification for tho.se who are 
administering them. 

Reliability is measured in several w'ays. First, .s 7 )//>-//c(//’reliability 
randomly divides the questions into two groups and checks to see that 
scores for each hall are roughly similar. .Second, in tests requiring 
subjective judgment, the scoring oi'diflerent raters can be compared 
to see that they do not seriously diverge. Reliability scores range from 
0 to 1 .0; the closer to 1.0, the higher the reliability (scores above 0.8 
are considered quite good). 

Finally, tcst-rctcst reliability c.xamines the stability of scores 
fi'oni one test administration to another. This is measured by giving a 
test to a group of leaders, waiting a month or two without providing 
any feedback, and then tidministcring the test a second time to the 
same group. If scores differ gretitly from one time to the next, the 
instrument's reliability is suspect. Usually, a reliability coefficient of 
at least 0.4 is acceptable, though correlations of 0.6 or 0.7 arc more 
desirable (Van Vefsor). 

Reliability and validity scores are always less than perfect, but 
test users can add credibility by exercising care in Ihe way they 
administer the tests: 

1. Minimize possible sources of imrelidhility. Tests should be 
administered at a time when lest lakers are alert. Linluirricd, and 
protected from distractions. They should understand the purpose of 
the instrument and should agree that the test is credible for that 
purpose (or at least be willing to keep an open mitui). 

2. Choose insirnments ihai are well wriuen and sharply foensed. 
Van Velsor points out that poorly constructed tests ctm alTcct the 
validity and reliability of the results: 

• Vaguely defined words (such as "conservative" or "communi- 
cation") can ex'oke \astly different respo^'^o'^ from jiartici- 
pants. 
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• Items with too few alternatives (“agree/disagree") can dis- 
guise important gradations of behavior; items with too many 
responses (“strongly agree,” “agree,” “slightly agree”) can 
become meaningless. 

• In using 360-degree feedback, items requiring a high degree of 
inference arc likely to be viewed more skeptically. For ex- 
ample, items focusing on attitudes rather than observable 
behavior usually involve more guesswork. In addition, differ- 
ent groups of raters may not be equally positioned to comment 
on a leader’s behavior. For instance, teachers are unlikely to 
know how a principal interacts with superiors. 

• Multipart items lead to ambiguity. When an item says, "articu- 
lates a clear set of expectations and adheres to them," it is quite 
possible that the answer is “yes” to the first part and "no” to the 
second part. 

3. Ensure congruence between test content and (he district’s 
beliefs about leadership. No matter how impressive a test's statistical 
validity, it will suffer a loss of credibility if it seems unrelated to the 
daily demands of leadership. When districts preach teamwork and 
collaboration but use in.struments that ignore tho.se dimension.s, te.st 
takers will have little motivation to take the process seriously. When 
participants see little of their world rellectcd in the instrument, they 
will quietly reject its relevance. 

4. Determine that feedback scales are meaningful. Most instru- 
ments group a large number of items into a smaller .set of leadership 
characteristics. For example, five items may be grouped under “com- 
munication,” five under “vision,” and so forth. Ideally, each item in a 
particular category should be strongly comelated with the others and 
should clearly rellect the underlying “theme” of the category. For 
example, items such as “frequently articulates reasons in writing,” 
“makes sure that others understand the rationale,” and “frequently 
refers to e.stablished goafs” seem to reflect “communication” and 
would probably be highly correlated. An item such as “listens sensi- 
tively to others' concerns” also involves a kind of communication 
skill but may not necessarily be found with the first three items. A 
coefficient of at least 0.7 is needed to have confidence in the reliabil- 
ity of the feedback scales (Van Vclsor). 

5. Use 360-degree feedback. An instrument's validity and reli- 
ability can be enhanced by including multiple perspectives in ihe 
assessment process. A growing number of tests supplement the 
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leader’s self-assessment with feedback from supervisors, teachers, 
and peers. Each group sees leadership from its own limited and 
possibly biased viewpoint, but using all perspectives permits a rea- 
sonable “triangulation” of the leader s actual performance. 

6. Debrief pariicipants after the test has been administered. The 
ultimate credibility of the process will rest less with .statistical analy- 
sis and more with the perceptions of participants. Their reactions will 
provide valuable clues about the meaninglulness of the instrument. 
The followup process (see chapter 4) should always leave room for 
the professional judgment of those who tooiv the test. 



Step 6: Consider Practical Issues 

How long does the test lake? Can it be scored locally? What’s the 
cost? No instrument will satisfy all your purposes, and the final 
choice will be the result of numerous tradeoffs. 



Step 7: Consider the Ethical and Legal 
Issues 

Leadership instruments can base major consec|uences fortho.se 
who take them. This is most evident when the tests are used for 
selection or evaluation, but even when limited to professional devel- 
opment they require the expenditure of valuable time and energy, and 
they may subject test-takers to di.sturbing feedback about their leader- 
ship skills. Districts have a major responsibility to ensure that their 
use of leadership instruments is both legal and ethical. 

The .loint Committee on Testing Practices, a cooperati\e group 
initiated by the American Psychological As.sociation. the American 
Educational Research Association, and the National Council on Mea- 
surement in Educatir)!!. has developed a "Code of Fair Testing Prac- 
tices in Education" ( 1 988 ). It identifies four major responsibilities lor 
those using tests. 

1 . The user should thoroughly examine test content, mtiniials. and 
supplemental)’ material to ensure that tests satisfy the purpose for 
which they were designed and that they are being u.sed w ith appropri- 
ate populations. 

2. Users should m;ike sure thtit test results are interpreted cor- 
rectly and used only for the intlicalctl purposes. They should also 
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uiUhcr evidence lo show ihal the inslrumenl is riiinilinj’ its slated 
purpose. 

•V Users should select and use tests that li;ive been developetl to 
avoid bias lelaled to se.x. race, and liandictiiiping position. Overt hitts 
is less common today than several decades ago, hut il results show 
dilTereniitil perlbrniance elated lo gender or race, users should nuike 
an elTort to deterinine why. 

4. Test lakers should be pi twidcd full inrorniation on the nature of 
the lest and its intended uses. Il is particularly important lor litem to 
know whether (or to what e.xtent ) their resjton.ses will be confidential. 



Step 8: Determine How /Vtuch Support 
the Instrument Provides for Followup 
and Professional Development 

Most formal asse-snienis conic with posllesl activities that help 
leaders rellecl on the results tind set gotils for continuing develop- 
ment. hut they vtiry in iiuality. The key questions: Are the lest results 
reported in a clear, uiulerstandable forimil'.’ Dv) the supporting materi- 
als prov ide test-takers with insights into the meaning of their leader- 
ship profile? Does the test package help adminisirtitors set an ageiula 
for improvenicnl? Is there evidence that leavlers w ho go through the 
testing and followup activities actually improve their skills'.’ These 
issues come into greater focus in ehtipier 4. 
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In many districts, assessment is an event; the 
feedback is, delivered, the accountability report is 
tiled, and everyone moves on to more pressing 
business. By contrast, best-practice assessment is a 
process in which providing feedback is just the first 
step in a much longer journey. 

Districts wishing to get their money’s worth from 
assessment must make sure tliat participants de- 
velop an accurate understanding of the feedback, 
that they use it as a tool to reflect on their strengths 
and weaknesses, and that tliey uansform it into a 
plan of action. 

This chapter’s contents: 

Selecting the Facilitator 
Deciding on the Setting 
Delivering the Feedback 
Forming a Development Plan 
Searching for Ground Truth 
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Fulfilling the Promise 
of Assessment 

As she cmcrccl the superinleiidenrs office, Anna Scbriiig found 
herself eorifroniing mixed emotions about the meeting to come. As 
a first-year principal, she uas eager to get some feedback on her 
perfornianec, and the district's new 360 -degree feedback program 
would give her information on how her teachers, peers, and super- 
intendent perceived her leadership, as well as insights into her self- 
assessment. 

At the same lime, she was worried that the results might not show 
her in a favorable light. Things had gone fairly smoothly, but it was 
alwavs hard to tell how others might feel. At times she even 
p(Muiered the unthinkable: a message that she wasn't really cut out 
lor administration. 

She wished she had the easy-going confidence of Randy Armani, 
her veteran eolleauue from Everett School. “These things are all 
alike," he had told her with assurance. 'They're looking for happy 
talk. So just go in, nod your head whenever they sa>' something, 
and have one or two goals that you can ‘work on.* I've already got 
in\ dogs and ponies all lined up," he had noted v\ ith a grin. 



veil vvliL'ii leaders arc committed to professional development and 
personal improvement, testing creates ambivalence. Will the test truly 
eaptiirc their strengths and vvcakne.sses? Will the results make them 
look had? Will it make any difference one way or the other? More than 
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any other factor, what happens the test will determine whether it 
becomes a meaningful contribution to Iheir development or an empty 
exercise that is quickly forgotten. Chappelow. commenting on "drive- 
by assessments," has noted that "providing assessment without de- 
\ elopmcntal planning and followup almost guarantees that the orga- 
ni/.ation does not get its money's worth." 

A worst-case scenario is when district officials report the assess- 
ment results to supervisors but do not bother to inform the partici- 
pants themselves. District leaders may feel that some kind of ticcount- 
abihty function has been satisfied, but the procedure will do little to 
improse the quality of leadershio. 

More commonly, participants learn the results but tire left to drav\- 
their own conclusions and take appropriate action. With motivated 
leaders and well-designed followup materials, this approach some- 
times leads to improvetnent, but equally often the process gets side- 
tracked as busy administrators put it aside "until 1 ha\e the time." 

The best-case scenario is a thoughtful, structured process that 
provides ample support to participants as they interpret the results 
and fine-tune their professional-development plans. While districts 
\ ary in the resources they can put behind an assessment program, this 
chapter is based on the assumption that a carefully structured and 
well-supported followup process will yield maximum benefits both 
for leaders and the districts they serve. 

With a well-chosen instrument that matches local needs, a district 
is positioned to reap great benefit from the process ol' assessing 
leadership. Howewer. administering the test is not tlie end of asses.s- 
ment: indeed, the real work has just begun. District officials face four 
key steps in following up on the assessment: selecting the facilitatrir, 
choosing the format or setting in which the feedback will be pro- 
vided. delivering the feedback clearly and thoughtiully. and translat- 
ing the results into workable plans for impro\ement. 



Selecting the Facilitator 

Choosing a good facilitator is critical. " I'hat person sets the tone, 
serves as the primary resource to help people understand their feed- 
back. and assists thetn in developing strategies for overcoming any 
obstacles to meeting their development targets" (Richard Lepsinger 
and Antoinette Lucia 1997). At a minimum, the persem chosen should 
have at least three qualities. 
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1 . Knowledge of the insinimenf. In some cases, vendors require 
that tests be administered and interpreted by people who have been 
specially trained and certified to use that particular instrument. The 
Principal Perceiver, for example, requires that facilitators receive 
both initial training and periodic updating to be certified. Even where 
this is not the case, participants have the right to expect that those who 
deliver the feedback are thoroughly familiar with the instrument and 
the meaning of the results. 

2. Sensitivity. Being asse.ssed is often an intimidating experience 
that can easily threaten confidence and self-esteem. Facilitators must 
be aware of these issues and. with sensitivity and insight, be able to 
help leaders confront discrepant information. They must also be 
ready to point out the positive aspects of the feedbtiek being pre- 
sented. 

?>. Credibility. Participants are likely to listen respectfully to 
facilitators who are knowledgeable and sensitive, but for the final 
critical step — applying the result.s — participants must feel that their 
guide understands their situation. Glibly advising a principal to main- 
tain a "customer focus” with parents will merely lead to cynicism 
unless the facilitator recognizes the daily reality of parents who don't 
know (or care) how their child is doing in school. In other words, 
facilitators should understand the conditions under which partici- 
pants are working. 

While there may be a number ol people within the district who 
meet the.se standards, an outside facilitator is sometimes the best 
choice. Internal facilitators — especially those with supervi.sory re- 
sponsibility over the participants — may elicit cautious, face-saving 
discussion rather than honest, wide-open discussion. An empathetic 
but honest iiutsider is more likely to stimulate the right kind of 
reflection. (In fact, supervisors can become participants themselves, 
giving them a chance to model reflective thinking and also sending a 
powerful message about the importance of assessment.) 



Deciding on the Setting 

The next step is lo determine how the feedback will be provided 
to participants. I.epsinger and Lucia describe three possible formats. 

1. Croup sessions. If a district is inv olving many of its adminis- 
trators in leadership assessment, the results can be presented in a 
group workshop. A group setting is not only cost-cITcctive. it also can 
sirengthen the feedback process by assuring leaders that they are not 
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alone and iliai iheir peers (even those they respect highly) may also 
have areas of weakness. In addition, group di.scussion can stimulate 
ideas that individuals acting alone might overlook. 

One potential disadvantage to group sessions is the discomfort 
leaders may feel in talking publicly about perceived weaknesses. 
Depending on the organizational climate, they may be more con- 
cerned with keeping face than with engaging in an honest appraisal of 
their strengths and weaknesses. In addition, a group .setting limits the 
individual attention any one leader can receive; issues that are impor- 
tant to some participants may never be di,scussed. 

2. One-on-one-settings. Another common approach is to meet 
with each leader individually, allowing full attention to his or her 
needs. One-on-one sessions also create an atmosphere of confidenti- 
ality, making it easier to talk about weaknes.ses and the need for 
change. 

However, person-to-person meetings may be more intense, since 
the participant receives the full, unwavering attention of the facilita- 
tor. Lepsinger and Lucia note that "the facilitator must have a sure 
sense of when to confront a recipient with painful truths and when to 
back off." 

Onc-on-one sessions are also time-consuming for the facilitator, 
who may easily spend two or three hours preparing and cairying out 
each meeting. When there are many participants, this approach can 
quickly become overwhelming, especially if the facilitator has other 
duties in the system. Compromi.ses are possible, however; a facilita- 
tor could begin by meeting with all participants to present the general 
e.xplanation and interpretation of the results, and then follow up with 
one-on-one sessions to consider individual issues. 

?>. Self-study. If neither group nor one-on-one .sessions are avail- 
able (perhaps due to lack of time), leaders can simply be given the 
results along with some followup material. (Many vendors provide 
self-guided booklets that provide intcipretations of the results as well 
as reflective and goal-setting activities.) Self-study provides maxi- 
mum tlexibility in scheduling (it can even be done in the comfort of 
home, away from the usual work distractions). It may also allow 
leaders to feel autonomous and in control, avoiding the “going to the 
woodshed" llavor of guided sessions. 

Nonetheless, self-study has notable disadvantages. (,)n their own, 
busy leaders may tend to give the activity a low priority, delaying 
until the feedback has lost much of its value. Misinterpretations are 
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always possible, and leaders reflecting in isolation may lack the 
perspective that comes from interacting with others. 

The.se decisions about who should present the feedback and in 
what setting should not he allowed to obscure another key issue: 
timeliness. Districts conducting leadership assessments should en- 
sure that feedback sessions are conducted as soon as possible after the 
instrument has been administered. As with any test, quick feedback is 
important; initially high interest tends to diminish as weeks or even 
months pass without any word of the results. Participants may even 
have trouble remembering the issues that were raised as they took the 
test. 

Finally, feedback should be delivered at a time and in a place 
where partieipants can focus their entire attention on the results. 
Group sessions can be scheduled for a morning or afternoon away 
from the work sites with their paperwork, phone calls, and other 
di.stractions. 



Delivering the Feedback 

The moment of truth in any leadership-assessment program is the 
delivery of the data obtained by the instrument. Will participants be 
able to understand the data’s meaning and grasp their implications? 
Test data can be complex; emotions often run high; and the implica- 
tions are not always immediately clear. Van Velsor has .suggested a 
simple rubric to sort through the key i.ssues by asking three kinds of 
que.stions; What? So what? and Now what? This section addre.sses 
the first two questions, and the following one suggests a process for 
converting the data into a workable plan for professional develop- 
ment. 



Wheat r?)o the Data Say? 

The first task in feedback sessions is making sure that partici- 
pants understand what the results are saying. Although many assess- 
ment instruments provide a variety of interpretive aids, the amount of 
information can be overwhelming. In particular, participants may 
need assistance in understanding the nature of the item scales, the 
meaning of the feedback form, the norms being used, and the break- 
down of individual items. 
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Understanding item scales. Typically, the items on a leadership 
inslrumcnl take one of two forms. Some are mastery items, asking 
respondents to indicate how well a certain skill is performed. For 
example, the scale may run from I (little skill) to (great skill) on 
items such as: 

• communicates expectations clearly 

• conveys respect for teachers' ideas 

• is well organized 

Others ing J'recjuency scales, asking respondents to indicate how 
often a behavior is observed. For example, on the items mentioned 
above, the scale may run from 1 (seldom) to 5 (very frequently). 

Van Vels(.)r notes that when using 360-degree feedback, fre- 
quency scales have the advantage of focusing on behavior that has 
been observed, making the assessment somewhat more objective 
(and thus more easily accepted). However, she also points out that 
frequency scales have the disadvantage of suggesting that more is 
better, which is not always true. "Paying attention to detail" is 
generally a positise behavior, but at some point it turns into 
micromanagement. 

Another issue is the number of possible ehoiees. Odd-numbered 
scales (for example. I to ,5) typically leave room for neutral or 
indecisive responses in the middle, leaving an escape hatch for raters 
who don't want to put much thought into the process (Van Veksor). 
FA cn-numbered .scales tend to nudge respondents into committing to 
one position or the other. 

A final question is whether the scale permits a response such as 
"not applicable" or "no opportunity to observe." Lacking such op- 
tions. respondents may be forced to reply without having a firm basis 
for their rating. On the other hand, they may find it easier to avoid 
taking positions on questions they are in a position to answer. 

Test u.sers will find few instruments that strike a peii'ect balance 
among these questions, but the issues should be raised during the 
feedback process to help u.sers better understand the meaning of their 
scores, 

interpreting feedback farnis. Leadership instruments \ ary greatly 
in how they report results to test takers. Typically, there is some 
combinatiem ol' numerical scores. narrati\ e explanations, and visual 
representations such as charts, graphs, and grids. While the.se reports 
arc often designed to be .self-explanatory, participants can still benefit 
from clear and concise demonstrations of how their data arc mapped 
out. 



^ V. 
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Understanding norms. In many cases, scores are stated in terms 
of comparison to some reference group. This is helpful information, 
since leaders (like everyone else) gauge their effectiveness by com- 
paring themselves to others. We often don't know how good we are 
until we know how good others are. At the same time, it is important 
to keep in mind with whom we’re being compared. If rank beginners 
are being compared with veterans, the gap could be discouraging 
unless they understand that their lower standing rellects differences 
in experience. 

This issue is especially important for school leaders, since many 
leadership instruments are standardized on business executives. While 
there are undoubtedly many similarities between leadership in busi- 
ness and leadership in schools, there are also powerful differences. 
For example, it makes sen.se to measure business leaders on their 
“customer orientation." For school leaders, keeping customers happy 
may require a very different .set of skills, even after they figiii'e out 
who the customers are. 

In many cases, the norm group is everybody who has taken the 
test — often a sizable group. While this gives an instant comparison 
with a large number of peers, this group may not be representative of 
the leadership population at large. Most likely, the ones who have 
taken the instruments are leaders who are especially interested in .self- 
evaluation and professional development. 

It's also important to note that, on many instruments, comparison 
to the norm is just a comparison. It lets leaders know where they fit in 
with other leaders, but unless there are studies showing that success 
on the test is correlated to success on the job. one has to be careful in 
drawing conclusions. 

An alternative used on a few instruments is comparison to an 
ideal .score. Tliat is. lest makers have established a hypothetical 
“perfect .score" and have compared the leader's results to that ideal. 
Van Velsor notes that comparison to an ideal provides a sense oi' 
challenge for ambitious leaders, but others may be discouraged by 
their inevitably less-lhan-perfect results. 

Analyzing the item breakdown. Test feedback typically presents 
scores on a number of general dimensions such as "communicates 
expectations clearly." “judgment." or “decisiveness." These catego- 
ries arc useful in identifying underlying themes in one's approach to 
leadership, but they can seem rather abstract. Analysis ol' individual 
items gives a more tangible picture of the specific behaviors that led 
to the overall score. For example, it is wt'iThwhile knowing that one 
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has an average score in “vision." but even more valuable to see that 
“communicates the vision" is high while “encourages others to take 
ownership of the vision" is low. 

Analyzing rater breakdown. On tests that involve 360-degree 
feedback, separate scores are given for the different categories of 
rater, such as superior, peer, and subordinate. Discrepancies among 
these groups can spark considerable interest and reflection, and the 
scores should be given careful attention. Van Velsor notes that while 
participants sometimes give greater weight to the opinions of super- 
vi.sors, perceptions of all raters are potentially valuable, since each 
sees different facets of the leader's behavior. These contrasts are 
especially informative when broken out as the concrete behaviors 
typically de.scribed by individual items. 



What Do the Data Meanc’ 

Once the scores are understood, attention turns to their implica- 
tions. While most instruments are ba.sed on theory or re.search that 
implies eertain leadership behaviors are more effective than others, 
assessments will almost never end up with a simplistic judgment of 
“good leader" or “poor leader." In.stcad. the results will show a 
combination of strengths and weaknc.sses. some of which are critical 
issues for the leaders to address, while others have only a marginal 
impact on succe.ss. 

For that reason, participants need to sort through the available 
data with some care, neither rejecting the findings out of hand nor 
embracing them uncritically. Data are simply data; they require 
human judgment to determine their significance. 

To illu.strate. we will imagine that Anna Sebring, the principal 
de.scribed at the beginning of the chapter, has received 360-degree 
feedback on the behavior “promotes organi/.aiional learning," Table 
3 shows the ten items on this particular scale; table 4 shows her 
scores. 

What conclusions should Sebring draw from these results? 
Lepsinger and Lucia suggest that the first step is to determine which 
results reneel strengths and which point to weaknesses. On instru- 
ments that are normed. a strength might reasonably be defined as any 
score in the upper quartile and a weakness as any score in the lower 
quartile. This lest, however, is not normed; rather, it uses an "ideal 
score" method, assuming that 3 is the goal. Users arc left to them- 
selves to decide the lines between strong, average, and weak. 
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T ' A B L E 3- 



Items That /Vleasure the Behavior 
'Promotes Organizational Learning' 



1. The principal has a distinct vision for the future of this 
school. 

I 2 3 4 5 

2. The principal frequently talks about ways we can reach 
our vision, 

1 2 3 4 5 

3. The principal e.xtends ownership of the vision to every- 
one. 

1 2 3 4 5 

4. The principal recognizes and celebrates innovative ef- 
forts. 

1 2 3- -4 5 

5. The principal provides funding for professional-develop- 
ment activities. 

1 2 3 -4 5 

6. The principal encourages us to visit other classrooms. 

I 2 3 4 5 

7. The principal gives teachers considerable leeway to make 
instructional decisions. 

i 2 -3 4 3 

8. When teachers in this school want to try a new method, 
they don't feel they have to get permission from the 
office. 

1 2 3 4 5 

9. The principal encourages discussion of new ideas at fac- 
ulty meetings. 

1 2 3 4 -5 

10. The principal is always putting articles and clippings 
about new ideas in teachers' mailboxes. 

I 2 3 4 5 
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Results of 360-Degree Feedback 


on 


the Behavior 'Promotes 
Organizational Learning' 

Self- Tearhc’i's’ 


Peers ' Supervisors' 


Items 


Ralini^ 


Riiliitii 


Rating 


Rating 


1 . Has a disiincl 
vision I'or iho 
ruuirc of ihis sch(H>l 


5.0 


2.5 


4.5 


5.0 


2. Always talks 
about wa\s to 
achieve ihc vision 


5.0 


2.1 


4.4 


5.0 


nxionds 

ownership of the 
vision (o ever\'one 


5.0 


2.5 


5.5 


4.0 


4. Recoin i/cs and 
celehrales 
innovalivc efforts 


4.0 


4.5 


4.6 


5.0 


5. Provides fundine 
lor professional- 
de\elopinent acli\ ilies 


4.0 


2.1 


5.7 


5.0 


h. Faici HI rages leacliers 
lo visit Ollier 
classrooms 


5.0 


1.5 


2.<S 


4.0 


7. (ii\es teachers leeway 
to make instructional 
decisions 


4.0 


4.h 


5.S 


4.0 


S. laico II rages 
discussion td iieu 
ideas at faculty 
meetings 


5.0 


5.1 


4.4 


5.0 


Frecjuently puts 
articles about new 
ideas in teacher 
mailboxes 


5.0 


2.1 


5.2 


4.0 


10. Makes teachers 
feel their 
cnniributions 
are appreciated 


4.0 


4.5 


5.5 


4.0 
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Obviously, differenl participants may apply different standards 
to their results. Like many edncators, Sebring automatically equates 
any five-point scale with the traditional grading system, so that a 5 
becomes an A. a 4 is a B, and so forth. So for her, anything over a 4 
(Bj is a definite strength, w'hile anything under 2..S (C-J is cause for 
concern. At least initially, facilitators should accept participants’ owm 
classifications, since the ultimate goal is to understand, not to label. 
Unrealistic perceptions can be gently confronted as the discussion 
proceeds. 

As Sebring looks at the results, she is relieved that her peers and 
supervisors rale her performance rather high, with no scores that 
could be considered weak. In thinking about this, she realizes that 
they have not really had a chance to see her in action. Because the 
as.sessment instrument did not have a “not observed" response, her 
colleagues could only judge her by their perceptions of her conversa- 
tions and meetings with them. Thus, their ratings may have been an 
indirect rellection of her own perceptions. 

In the teachers' ratings, four items fall into Sebring’s .self-defined 
“w'cak" category: 

• always talks about ways to achieve the vision 

• [)rovides funding for professional-development activities 

• encourages teachers to visit other classrooms 

• frequently puts articles about new ideas in teachers' mail- 
boxes 

Strength areas identified by teachers inclutle: 

• recognizes and celebrates innovative efforts 

• gives teachers leeway to make instructional decisions 

' makes teachers feel their contributions are valued 

Lepsinger and Lucia suggest that, in considering w'caknesses and 
strengths, participants distinguish between behaviors that will have a 
high impact on the organization and those that will have less impact. 
Sebring's strengths and weaknesses, as w'ell as .several areas that she 
is not sure about, are displayed in table 5. 

.Sebring can find at least one weakness she considers low-impact: 
not putting articles in teachers' mailboxes. Recent staff reductions 
combined with a new high-stakes stale as.sessment program have kept 
her teachers near exhaustion; they barely have lime to read unsolic- 
ited articles, much less act on them. In any case, her veteran staff 
members, having seen heralded reforms come and go. are inclined to 
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t A B L E 5 



Separation of Strengths and 
Weaknesses into High-' and Low- 
Impact Categories 




More i nipt t run U 


Lews iniporfivU 


Sireni^fhs 


Recogni/.es and 
celebrates innovative 
efforts 






Gives teaeliers lee\va\ 
to make instniciional 
decisions 






Makes teachers feel 
iheir contributions 
are appreciated 




U ('ukfuw \<‘.s 


Has a distinct vision for 
the future of tliis school 


Hncouragcs teachers to 
visit t)ther classrooms 




Always talks about 
ways to achie\e the vision 


Frequenils puls articles 
about new ideas in teacher 
mailboxes 




Hvtcnds ow nership 
of the vision to eversonc 




1 nvU’ur an’a.\ 


Why is faeiilly unclear about iny vision'.^ 




Wh\ does faculty not reeogni/e 
professional dcvelopnicm? 


in\ efforts in funding 




Why don't teaeliers sec faeult\ 
new ideas'.^ 


meetings as a forum for 
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skeplicisrn about the latest bandwagons. They do seem receptive to 
concrete local examples of new ideas, and Sebring realizes she has 
shared a number of such ideas in hallway conversations u tactic that 
this a.sse.ssment doesn't recognize). All things considered, she does 
not see this particular “weakness” as a major problem. 

In addition, the low score on encouraging teachers to visit other 
classrooms does not strike her as a high-impact issue. It's a nice idea 
but probably not the kind of thing that can transform a school. 

This initial classification of strengths and weaknesses should be 
followed by one other step: articulating issues that need to be clarified 
(Lepsinger and Lucia). The meaning of the feedback is not always 
clear, and participants should be encouraged to identify any areas that 
arc ambiguous or puzzling. Sebring indeed has several questions 
about her results: 

• Why do teachers .seem uncertain about her vision? 

• Why do teachers rate her so poorly on her ability to find 
funding for professional-development activities? 

• What explains the difference between her perceptions and the 
faculty's perceptions about what happens at faculty meetings? 

In considering the first question, she realizes that as a first-year 
principal she has tried to avoid coming on too strong until she gets a 
feel for the school. This initial hesitation has been reinforced by the 
fact that her predecessor had been an energetic promoter of “vision” 
and had enticed the staff into spending many hours developing their 
“twenty-first century dream.s.'' only to blithely ignore the rc.sulting 
product. Anna had realized early in the year that the last thing these 
cynical teachers wanted to hear was more rhetoric about vision. Thu.s, 
while she had a distinctive vision for the school, and shared it freely 
with her administrative eolleagues, she had been soft-pedaling her 
ideas when talking with her teachers. 

She was hurt by the teachers' low rating on the funding question, 
since .she had spent many hours lobbying, negotiating, and just plain 
begging for her .school's fair share of the money. After thinking about 
it. however, she realized that most of this effort had gone on behind 
the scenes. Her sense of professionalism makes her reluctant to talk 
about d .strict politics with her faculty, so they can judge her only by 
the results, which are admittedly meager: the district is simply strapped 
for cash this year. 

The question of faculty meetings is more puzzling. She believes 
that meetings should be used for professional dialogue rather than 
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roulinc announcemcnls. In her view, ihe menthly meetings had been 
rather stimulating. After discussing this with the facilitator, she 
decides that she will have to talk quietly with a few teachers to find 
out why their perceptions are so different from hers. 

After dealing with ihe.se issues. Sebring and the facilitator dis- 
cuss the implications of the assessment. Three issues seem to stand 
out. First, she has a real strength in making teachers feel valued, 
accepted, and respected as autonomous professionals. In fact, their 
ratings in this area were consistently higher than her self-assessment. 
.She is plea.sed by this finding, since affin.iation and support arc 
important values for her. 

Second, it appears that she has not conveyed her vision to the 
staff. While she still defends her decision not to freely dispense 
visionary rhetoric, she also rccognixes the importance of collectively 
facing questions about the .school's future. She know ; that the state 
assessment is a new way of dt)ing business, and simply reacting to 
mandates w'ill not get the school where it needs to go. She also 
reali/.es that the high scores b)r respecting teacher autonomy may not 
be an unalloyed strength: at some point, “respecting autonomy" may 
become “laissex-faire." 

Finally, she reconsidered her lowest score ( ■'encouraging letich- 
ers to visit other classrooms"). Although she had initially ranked this 
as a low-impact item, she now wondered if it represented ;i deeper 
issue. Early in the year she had suggested such visits to a few 
teachers, but backed off when they were immediately dismissive. 
Although she still didn't think that mandating visits would accom- 
plish much, she lurw wondered if she had dro|;ped the idea too 
quickly. Thinking about it. she realized that the I'ticulty had often 
displayed a “live and let live" philosophy that frowned on the notion 
that some teachers might be better than other teachers. Agtiin she was 
bleed with the realization that her desire for a harmonious school 
miahl he eliminating the kind of creative conflict that leads to learn- 
in^z. 

This e.xample should make it clear that interpreting feedback is a 
much more subtle process thtin simply getting a thumbs-up or thumbs- 
down on a checklist of traits. What initially appears to be a strength 
may contain elements of weakness, and vice-versa. Sonic issues may 
remain ambiguous, and even obvious strengths oi weakne.sses may be 
relatively unimportant in the larger .scheme of things. In evaluating 
assessment results, both facilitators and parliciptints should recognize 
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liiat ihcY are not so much amving at a conclusion as setting out on an 
open-ended journey. 



Forming a Development Plan 

All this activity is little more than an intellectual exercise unless 
leaders are able to convert their results into a plan for improvement. 
If there are weaknesses, those need to be addressed. If there are 
.strengths, those should be exploited. If there are uncertainties, those 
should be explored further. 

For thiit reason, participants in assessment should be encouraged 
til develop <'in action plan as soon as possible. Lepsinger and Lucia 
sa\. "If participants do not lake meaningful steps to translate their 
feedback into action within two weeks of leaving the work session, 
they will probably never do so." Doing so involves six key steps. 

1 . "Consoliclaiiim" the feedhuck. Lepsinger and Lucia note that 
leadership as.sessmcnts are typically rich in data and insights. It intiy 
take scNcral days just to assimilate what has been learned, without 
even getting started on the action plan. Facilitators should not plan to 
leap From feedback to action in one meeting. 

2. Setting (levelopmeiil itoals. At this point the feedback analysis, 
as iasightful as it may he. needs to be shaped into an agenda for 
action. The plan should be couched in specific behavioral terms: that 
is. What must the leader do to build leadership capacity? (Banal 
generalities such as "be more decisive" and "impro\'e communica- 
tion" are rarely helpful.) To continue the example begun earlier, 
.Anna .Sebring decides that her lop priority is leading her staff to 
collectively tiddress the challenges facing them. That is. she must find 
wavs to enuaize teachers in dialogue about future directions and get 
them to collaborate on curricular and inst: uclional derisions, even tf 
this occasionally sparks conflict. 

Chappelow suggests three questions that may be helpful in choos- 
ing a goal: "Does the goal motivate and energi/.e me? Will achieving 
this goal help me be more effective in my current position? Will my 
organi/.ation benefit from this goal?" 

.T. Choosiiiy a .\traleyy. De\'elopmenl goals aiio 'o mi c partici- 
pants to places they have newer been belore. so a search for creati' c 
strategies is essential. Lepsinger and Lucia suggest five possible 
approaches. 
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. First, participants may find what they need in the rich profes- 
sional literature on leadership and change. Although much of this 
material is driven by fads and self-promotion, it contains some 
thoughtful advice and genuine nuggets of wisdom. Te.st publishers 
often include bibliographies tailored to the issues raised by their 
instruments, and several professional journals contain helpful re- 
views of relevant books. A newer approach is to join an administra- 
tive LIS’l SERV such as those operated by the American Association 
of School Adm.ini.strators and the ERIC Clearinghouse on Educa- 
tional Management. These discussion groups make it easier to find 
other administrators facing the same problem. 

Second, participants may engage in .self-monitoring. After iden- 
tifying a key behavior to strengthen, they simply chart the number of 
times they use it. f)vcr time, this tracking process keeps leaders on 
target and makes the skill seem increasingly natural. 

Third, participants can work with a coach, mentor, or consultant. 
When a desired behavior is complex, .self-monitoring is le.ss effective 
than being exposed to modeling and dialogue with an experienced, 
knowledgeable guide. 

Fourth, specific training programs and .seminars are plentiful, 
e.specially those dealing with well-defined skills such as delegating, 
time management, and team-building. 

Finally, on-the-job assignments can enhance targeted skills. For 
example, a principal interested in developing his team-building skills 
could take on responsibility for a districtwide curriculum committee. 

4. Wrirhi^ a development plan. Lepsinger and Lucia emphasize 
the importance of putting the development plan into tangible form. 
An effective written plan will include a clear statement of the goal, 
the standards for measuring success, the change strategies, the related 
action steps, and key resource people. 

* Linked by ihc K12ADMIN li.<*;tserv, admini.strators can .share ideas, help each 
(Uher solve problems, cwdiange inlbrinatioii. and make contacts with gcogiaphicully 
remote colieaiiues. Inaddilion to faciliiaiing dialogueatnong subscribers. K1 2ArJMIN 
pro^ ides an avenue I'orshaiing Inrormatioaahout such things as upcoming conicrcnccs 
and useful publications. 

There is no charge to subscribe \n Kl 2ADMIN. I'o subscribe, send the message 
subscribe K12AI)MIN Ymir Name le.g.. K 12ADMIN .lane Doc) to the following 
email address: Iist.ser\ listserv.syr.edu 

For additirmal information about K12AILMIN, coaiaci Marv Lou Finne. user 
sLT\ ices coordinator. LRIC C'learinghouseon F^'ducalional Management, l'iu\ersit> of 
Oregon. Voii'c: ib4l ) .Ob 2L^3. l-mail: mlfinnc(^ eric.uoregiMi.ethi 
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5. Monitoring, the plan. Paiticipants should be encouraged (or 
required) to take slock periodically, reviewing their progress, identi- 
fying difficulties, and modifying strategies where appropriate. 

6. Supporting the development process. This kind of professional 
development is not inherently expensive, but districts nonetheless 
should be ready to provide any resources that may be necessaty. 
Having invested money in the assessment and the delivery of feed- 
back, it makes little sense to tie the purse strings. Participants who are 
left to fend for themselves will hear the message (intended or not) that 
assessment is a ritual rather than a chance for real change. 



Searching for Ground T ruth 

Getting direct, unvarnished feedback about leadership capabili- 
ties is a nervous experience for almost everyone, even highly capable 
leaders. In fact. Lepsingerand Lucia note that the strongest leaders — 
those with unquestioned belief in themselves and their skills — may 
find it most diffieult to have those beliefs challenged. 

School leaders, who are always under pres.sure to accomplish a 
great deal with limited resources, are especially vulnerable. Con- 
fronting a wide array of ambiguous issues, and facing multiple 
constituencies with conflicting agendas, they often place a premium 
on appearing strong and in control. 

Kaplan and Paulus note that executives — like everyone else — 
put a lot of energy into maintaining their self-image. They may be 
willing to make fine adjustments, but major changes are likely to be 
resisted. For example, a principal who prides him.self on li.stening to 
others might be willing to admit that on a particular occasion he failed 
to listen to a teacher, but would probably resist evidence that a 
majority of his staff members considers him to be a poor listener. Or. 
he may rationalize away the evidence by saying. “They don't under- 
■stand what I’m trying to do." 

Dealing v/ith such concerns requires a thoughtful, sensitive fa- 
cilitator who can provide participants with positive affirmation while 
also challenging them to improve. Several guidelines may be helpful. 

I. Listen first. Lepsinger and Lucia argue that directly challeng- 
ing participants' perceptions often leads them to dig in their heels. 
Preferably, facilitators should listen to arguments and rationaliza- 
tions without immediately directly challenging them. “By letting 
recipients vent, you are clearing the way for them to acknowledge 
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and accept at least a few of the messages they received and thereby 
increasing the likelihood that they will act on them.” 

This advice is reinforced hy the simple fact that score interpreta- 
tions are .sometimes ambiguous, and that apparent weaknesses .some- 
times repre.sent a best-possible response to the leader's unique cir- 
cumstances. For instance, a test of visionary leadership might con- 
sider it a weakness that a principal fails to articulate and frequently 
discuss the school's \ ision for the future. Yet if the previous principal 
talked ad naiiseuin about vision but never followed through, the staff 
may be understandably cynical about this kind of happy talk, and the 
new principal may be wise to tone down the rhetoric and build 
commitment to vision in other ways. 

2. Focus on what can he learned rather than on the raw scores. 
Test .scores arc merely rcllections of underlying behavior, not ends in 
themselves. Knowing how' one compares with other leaders is not as 
valuable as knowing how one can become more effecti\ e on the job. 
Participants should leave the session with heightened understanding 
of their own approach to leadership as well as a plan for continuing 
development. 

3. Focus on slrei}j>ihs as well as w'caknesses. People often un- 
dergo assessment using a deficit model that assumes the goal is to fi.K 
what's broken. In reality, improxement can come from leveraging 
strengths as well as remedying weaknesses. For example, a leader 
whose assessment shows strong interpersonal skills may be encour- 
aged to begin consciously using those abilities in new ways. In 
addition, zeroing in on strengths ean alleviate some of the an.xicty 
normally found in receiving feedback, and this positive approach can 
help convince the participant that the test is credible. 

4. Focus on behavior rather than abstract cjualities. Although 
people are often quick to reduce leadership to convenient short-hand 
abstractions ("communication,'' "vision," "decisiveness"), those broad 
categories by themselves are not very informative. If an assessment 
indicates that you are below average on vision, how do you beeonie 
above average? What specific attitudes and behaviors have to change? 

In their book Ho/ie Is Not a Metlunh Gordon Sullivan and Michael 
Harper describe the journey the U.S. Army has taken to become a 
learning organization. At the heart of the process is the w illingness to 
face the brutal facts — what the authors call "ground truth." Denying 
what is will not lead to what should he. Only pervasix'e, persistent 
evaluation will let us know when we go off course. 
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While il is always painful to confront our own failures and 
inadequacies, the payofi' for this kind of honesty is huge: an imprm ed 
capacity to do the job \\ e v\ ere meant to do. Becoming better equipped 
(o help children achie\'e their goals is worth a few temporary dents in 
our self-esteem. 
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No matter how you define leadership, you can 
probably find an instrument to match. The as- 
sessments surveyed in this chapter represent a 
modest sampling of the instruments available. 

Benchmarks 

COMPASS: The Managerial Practices Survey 

The Comprehensive Leader 

Educational Adininistrative Style Diagnosis Test 
(EASDT) 

Educational Administrator Effectiveness Profile 
Leader Behavior Analysis U (LBAII) 

Leadership Competency Inventory (LCI) 
Leadership/Impact’* 

Leadership Orientations 
Leadership Practices Inventory (LPI) 

Leadership Skills 

Leadership Sphere Inventoiy' (LSI) 

Leadership Workstyles 
Life Styles Inventory (LSI) 

Myers-Briggs Type Indicator (MBTI) 

NASSP Assessment Centers 
The Principal Perceiver 
Professional Development Inventoiy 
Profile of Aptitude for Leadership (PAL) 

Tlie Sui'vcy of Leadership Practices 
The Survey of Management Pmctices 

8 3 




TT 

X he instruments described in this chapter represent the range and 
varieties of' leadership assessment available to school districts, with 
emphasis on products from commercial vendors, since these are most 
likely to come with support materials. 

These capsule summaries are not intended to be rigorous analyses 
of cither technical quality or suitability, nor should their inclusion be 
construed as an endorsement of their use. As frequently noted in the 
preceding chapters, potential users are the only ones who can decide 
whiLh test best serves the needs of their schools. Instead, this listing 
is designed to provide school leaders with a convenient survey to 
begin their search. 

Readers seeking a more indepth review will find some of these 
instruments described in greater detail in Feedback for Managers: A 
Review and Comparison of Multi-rater Instruments for Management 
Development (Jean Brittain Leslie and John W. Fleenor). 



Benchmarks 

Center for Creative Leadership 
P.O. Box 26300 
Greensboro. NC 27438-6300 
Phone: 336-288-7210 
Fax: 336-288-3999 
www.ccl.org 

Purptise 

Benchmarks is a professional-development instrument designed 
to measure strengths and wcakne.sscs of executives. 
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Target Group 

Middle- and upper-level executives. 

Description 

Benchmarks consists of 164 items. The largest section yields 
feedback in sixteen categories. Four are in the area of ‘‘meeting job 
challenges": resourcefulness, doing whatever it takes, being a quick 
study, and decisiveness. 

Five are in the area of "leading people"; leading employees, 
setting a developmental climate, confronting problem employees, 
work team orientation, and hiring talented staff. 

Seven are in the area of "respecting self and others": building and 
mending relationships, compassion and .sensitivity, straightforward- 
ness and composure, balance between personal life and work, self- 
awareness. putting people at ease, and acting with flexibility. 

Another section generates feedback on six “problems that can 
stall a career": problems with interpersonal relationships, difficulty in 
molding a stalT. difficulty in making strategic transitions, lack of 
follow-through, overdependent. and strategic differences with man- 
agement. 

A third section yields information on how the leader handles a 
variety of typical business assignments, and the final section asks 
raters to identify which eight (out of sixteen) success factors are most 
important in their organization. 

Response forms arc provided for the leader and eleven obser\ ers 
(supervisors, peers, and subordinates). Responses are on a five-point 
Likert scale, ranging from "not at all" to “a very great extent" on the 
first section. The scale on the second section (derailment factors) 
ranges from “strongly di.sagree" to “strongly agree." w'hile the third 
section (ability to handle various Jobs) ranges from “among the 
worst" to “among the best." 

Feedback 

Participants are given a feedback report divided into three sec- 
tions: leadership skills and perspectives, problems that can .stall a 
career, and handling challenging Jobs. Feedback includes average 
ratings by self and others; comparison of ratings to norm groups; 
importance ratings; and an item-by-item breakdown. 1'he report also 
highlights (lie fifteen highest and lowest rated items within each 
rating group, as vv'ell as items where the range of responses was three 
points or higher within the same group of raters. Norms are based on 
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a sample of high-level or mid-level managers, depending on the level 
of the person being rated. 

Followup 

The publishers provide a developmental learning guide that helps 
participants analyze their results, set a developmental goal, choose a 
strategy, and implement the plan. The Center for Creative Leadership 
also offers developmental workshops. 

Theory and Rationale 

Benchmarks is based on research on the developmental experi- 
ences of business managers in Fortune-oOO firms. Interviews and 
surveys asked executives to describe key events in their managerial 
careers and what they had learned from these experiences. The results 
led to sixteen categories of key developmental events, as well as six 
factors that can cause "derailment.” 

Administration 

Tests can be self-administered. Scoring is done by the publisher, 
though scoring software can be licensed. The Center for Creative 
Leadership requires certification for trainers and facilitators who will 
be giving feedback. 

Statistical Validation 

Not provided with review materials. 

Uses 

Most appropriately used for professional development of experi- 
enced managers. 

Cost 

A set of Benchmarks instruments, which includes twelve surveys 
to assess one person, eosts ,S245. 



CTOySdlPASS: The /Vtanagerial Practices 
Su r vey 

Manus Associates 
100 Prospect Street 
South Tower 
Stamford. CT0690I 
Phone: S()()-44.S-0942 
Fax: 203-.226-3890 
Email: maniisl ((’''aobeom 
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www.rightmanus.com 
Contact: Debbie Home 

Purpose 

COMPASS: The Managerial Practices Survey provides informa- 
tion on current leadership behavior to assist in professional develop- 
ment. 

Target Group 

Managers at all levels in business, public, and military organisa- 
tions. 

Description 

COMPASvS consists of seventy items providing feedback in four 
clusters containing fourteen scales: communicating (informing, clari- 
fying, monitoring), decision-making (planning, prohlem-.solving. con- 
sulting, delegating), motivating (inspiring, recognizing, rewarding), 
and building relationships (supporting, mentoring, networking, 
teambuilding). Respondents are asked to rate behavior, ranging from 
1 (“never, not at all”) to 4 (“usually, to a great extent”), with "not 
applicable" and “don't know" responses allowed. 

Leaders rate themselves and are also provided feedback from up 
to eight peers and subordinates. Leaders and their supervisors arc also 
asked to rate the importance of each category for the particular 
setting. 

Feedback 

Re.suits are reported numerically and graphically. Feedback in- 
cludes an overall score for each scale as well as results for individual 
items, with side-by-side comparisons of assessments by self, col- 
leagues. and subordinates (“direct reports"). Feedback on delegating, 
rewarding, and mentoring is provided only from subordinates. Im- 
portance ratings by supervisor and .self show the relative importaiiec 
of each category for the work environment. 

Followup 

Development and planning guides are a\ailablc to help partici- 
pants understand the fourteen practices and put them into action. 
Developmental workshops are also available from the publisher. 

Theory and Rationale 

COMPAS.S w'as developed from an extensive research program 
hcarlcd by Gary Yiikl, using factor analysis, judgment, and deduction 
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to create a taxonomy of behaviors related to managerial effective- 
ness. 

Administration 

COMPASS is self-administered, taking about twenty to thirty 
minutes to complete. Scoring is done by the publisher and reported in 
about two weeks. Users must be certified by Manus, which offers 
certification workshops. 

Statistical Validation 

Ratings of internal consistency and test-retest reliability are high, 
with internal reliability ranging from moderate to high. Studies indi- 
cate that some of the scales conelate significantly with performance 
on the job; three scales (clarifying, monitoring, and networking) have 
been found to correlate with effectiveness for elementary principals. 

Uses 

COMPASS is most appropriately used as a professional-devel- 
opment tool to help leaders understand and improve their managerial 
practices. 

Cost 

COMPASS is priced at .$225 a set for 1-50 sets, $200 for 51-100 
sets, $180 for more than 100 sets. A set consists of a self-a.ssessment 
instrument, eight copies of peer and subordinate instruments, an 
importance questionnaire for the supervisor, publisher .scoring of the 
results, a computer-generated feedback report, and a manual. 



The Comprehensive Leader 

HRDQ 

2002 Renaissance Boulevard #100 
King of Prussia, PA 19406-2756 
Phone; 800-633-4533 
Fax; 800-633-3683 
www.hrdq.com 

Contact; Laurie Ribblc Lihove (LRLIBOVp'(o>HRDQ.com) 

Purpose 

'I'he Comprehensive Leader is designed to help participants iden- 
tify their strengths in the area of strategic and visionary leadership 
and formulate professional-development plans. 
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Target Group 

Leaders in many types of' organizations, profit or nonpront. The 
assessment is not limited to those with formal supervisory authority 
over the people they are leading. 

Description 

The Comprehensive Leader consists of forty items assessing the 
leader in four areas; knowledge of self, knowledge of others, knowd- 
edge of the organization, and knowledge of the world. Respondents 
are asked to indicate the degree to which the statement is true of them: 
completely characteristic, mostly characteristic, somewhat character- 
istic, mostly uncharacteristic, or completely uncharacteristic. Related 
surveys arc available for observers (peers, subordinates, or supervi- 
sors). 

Feedback 

Test-takers are given scores in each of the tour dimensions, 
ranging Irom l()-.‘^(); scores of 40 or abewe arc considered to he 
“relative strengths." (If no dimension has a score above 40. (he one 
with the highest subtotal is designated a relative strength.) The 
publishers note (hat norms have not yet been established and that the 
cutoff score of 40 should be regarded as an estimate. 

Scores may show strengths in from one to four dimensions, in 
differing combinations. Forexamplc, a participant may have strengths 
in “knowledge of self and “knowledge of the organization," or in 
“knoVv'ledge of organizations" and “knowledge of the world." For 
each of the fifteen possibilities there is a profile consisting of a one- 
paragraph description and several questions focused on continuing 
growth. 

Followup 

Participants receive a booklet containing explanations of the 
scores and suggestions for acting on tlie insights gained through the 
assessment. A facilitator's guide includes instructions for presenting 
a feedback session, transparency masters, and additional develop- 
ment activities. 

Theory and Rationale 

The Comprehensive Leader was designed as an “casy-to- train" 
model focused on the essentials of visionary leadership. A review of 
the leadership literature identified more than 150 key leadership 
behaviors that wmre sorted into categories. After additional analysis, 
the test developers formulated a leadership model around four major 
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dimensions: knowledge of self, knowledge of others, knowledge of 
the organization, and knowledge of the world. The assumption is that 
the leader's awareness of these four dimensions is the root of pensonal 
conviction and earned credibility. 

Administration 

The instrument can be self-adininistered and self-scored. The 
instrument takes about ten minutes, scoring five to ten minutes, 
profile development about fifteen minutes. 

Statistical Validation 

Not provided with review materials. The publishers note that data 
collection is ongoing. 

Uses 

Most appropriately used for leadership development. 

Cost 

A preview pack containing test booklet, feedback form, and 
facilitator's handbook is available for $45. Five-packs of both the 
participant form and feedback form cost $40. with quantity pricing 
available. 



Educational Administrative Style 
Diagnosis Test (EASDT) 

W, J. Redd in and A.ssociales 
P.O. Box 324 

Fredericton. New Brunswick 
Canada E3B 4Y9 
Phone: 506-452-7194 
Fax: 506-452-293 1 

Purpose 

The Hducational Administrative Style Diagnosis Test is designed 
to identify and siiinulate thinking about the styles of educational 
administrators. 

Target Croup 

The EASDT is designed solely for use by educational administra- 
tors. 
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Description 

The instrument consists of fifty-six forced-choice items probing 
various dimensions of administrative style. The instrument as.sesses 
task-orientation, relationship-orientation, and effectiveness (the ap- 
propriateness of a particular style in a given situation). The interac- 
tion among these three dimensions leads to eight possible styles: 
missionary, compromiser, developer, executive, deserter, autocrat, 
bureaucrat, and benevolent autocrat. 

Feedback 

Results are self-.scored and self-recorded. The results include 
scores for each of the eight .styles; higher scores indicate that the 
participant leans toward that style, while very high scores indicate a 
dominant style. Results can be graphed for a quick overview, and 
participants are also provided vvith an overall “synthesis" score. Brief 
interpretations of the different styles are provided. An associated Test 
Interpretation Manual is available. 

Followup 

Not provided with review materials. A guide for facilitators 
suggests several formats for helping participants understand the re- 
sults. 

Theory snd Rationale 

The EASDT is based on the “3-D Theory of Administrative 
Effectiveness,” which uses the widely recognized coneep's of task- 
orientation and relationship-orientation from a situational point of 
view. 

Administration 

The EASDT can be self-administered and self-scored in about 
thirty minutes. 

Statistical Validation 

Not included with review materials. The EASDT has been fre- 
quently used in dis.sertation research. 

Uses 

The EASDT is designed solely for use in training and develop- 
ment, and should not be u.sed as an appraisal instrument. 

Cost 

The publishers will make available photocopies for free use for 
educational purpo.ses only. Otherwise, the instrument is no longer 
available. 
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Educational Administrator Effectiveness 
Profile 

Human Syncrgislics 
39819 PlynioLilh Road 
Plymoiilh. MI 48170 
Phone: 734-459-1030 
Fax: 734-459-5557 
WWW. humansyn.com 

Purpose 

This Hducalional AdniinisUalor ElTecliveness Profile is designed 
10 help school adminislrators understand their managerial and leader- 
ship behax'iors and develo|> their skills in tho.se areas. 

Target Ciroup 

K-12 school administrators. 

Description 

The instrument consists of 1 20 items using a :sCvcn-point Likert 
scale ranging from “almost never" to "always." Questionnaires arc 
provided lor ihe leader and for others (supervisors, peers, and/or 
subordinates.) Most of the questions measure eleven specific man- 
agement skills: setting goals and objectives, planning, making deci- 
sions and solving problems, managing business and fiscal affairs, 
assessing progre.ss. delegating responsibilities, communicating, build- 
ing and maintaining relationships, tlcmonstrating professional com- 
mitment. improving instruction, and developing staff. 

In addition, ten questions lead to "summary perceptions" about 
leadership, including "have a vision of what could he and help others 
work tow'ard it." "convince staff that their effort makes a difference." 
and "provide a work einironment where people care about each 
other." 

Feedback 

Participants receive graphic ;iud numeric feedback on summary 
percejttKins and the eleven managerial skills (for "self" and "other" 
ratings). Itcm-by-item breakdowns are also available. 

Followup 

I’hc publishers provide a self-development guide containing de- 
tailed discussions and interpretations for each of the eleven manage- 
ment skills, as well as advice on formulating an action plan for 
personal improvement. 
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Theory and Rationale 

Not provided with review materials. The .self-development guide 
notes that the eleven categories of managerial skill were developed 
through extensive re.search. 

Administration 

Not provided with review materials. 

Statistical Validation 

Not provided with review materials. 

Uses 

Most appropriate for leadership development in K-12 settings. 

Cost 

I'hc co.st is $4.S fora package of the profile instruments. 



Leader Behavior Analysis II (LBAII) 

Blanchard Training and Development 
1 25 Stale Place 
Escondido, CA 92029 
Phone: 8()()-728-60()() 

Fax: 619-489-8407 
www.hlanchardtraining.com 

Purpose 

The LBAII is designed to give leaders a hotter understanding of 
their leadership style by contrasting self-perceptions and other's 
perceptions (boss, associates, team members). 

Target Group 

Leaders and managers in all types of organi/.ations. 

Description 

The LBAII consists of twenty hypothetical leadership situations 
to which participants are asked to choose the appropriate strategy 
from the four options listed. Forms are provided for the leader and 
others familiar with his or her work. 

Feedback 

The feedbaek pro\ ides numeric and graphic data showing how 
the leader and others rated the frequency with which each of the four 
LBAII stylos is used. "Effectiveness scores” (based on the appropri- 
ateness of each response to the hypothetical situations) arc also 
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computed. The feedback profile is organized around four questions: 
Do I see myself as others see me? Am I flexible? Do I manage people 
differently? Do I diagnose well? 

Followup 

The publishers offer a variety ol books, articles, visual materials, 
and training programs c'^ntered on the concept of situational leader- 
ship. Training for trainers is also available. 

Theory and Rationale 

The LBAII is based on the Hersey and Blanchard theory of 
situational leadership, which assumes that the “right” leadership 
behavior depends on matching the appropriate style with the needs of 
employees. 

Administration 

The LBAII is administered onsite. It can be self-scored or can be 
computer-scored by the publisher with more feedback. (Onsite li- 
censes are available for computer scoring.) 

Statistical Validation 

Not provided with review matei iais. 

Uses 

Most appropriate for professional development. 

Cost 

The LBAII costs ,'t)(S.95 per package, including the assessment 
form and scoring materials. 



Leadership Competency Inventory (LCI) 

Hay/McBcr 

Training Resources Group 

1 16 Huntington Avenue 

Boston, M A 02116 

Phone; KOO-729-8074 

Fax: 617-927-5060 

Email: trg_mcbcr@ haygroup.com 

http://trgmcber.haygroi,ip.eoin 

Purpose 

The LCF measures four key leadership competencies to assist in 
development of leadership capacity. 
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Target Group 

The LCl is aimed al leaders in business and nonprorit organiza- 
tions. 

Description 

The LCl eonsists olTliirty-eight items that assess four leadership 
eompeteneies: information seeking, eonceptual thinking, strategic 
orientation, and customer-service orientation. Items assess behaviors 
using a five-point Likert scale, ranging from 0 (“never'*) to 4 (“ex- 
tremely frequently"). Related questionnaires arc provided for super- 
visors, peers, and/or subordinates. 

Feedback 

An interpretive booklet allows participants to profile and under- 
stand their scores. Ratings are expressed in terms of frequencies, with 
greater frequency seen as preferable for all four com[)etencics. The 
booklet provides additional information on the level of competencies 
(that is. on how well they are perldrmed). 

Followup 

The publislier provides a “leadership competency development 
assistant" that provides interpretations and extended examples of 
each competency, addresses obstacles to competency development, 
and prox ides resources for further development. 

Theory and Rationale 

Not provided with review materials. 

Administration 

■Sell-administered and scxxred. 

Statistical Validation 

Not provided with review materials. 

Uses 

Most appropriate for pnd'essional devclopmcni. 

Cost 

.S6.S per package of 10 self-questionnaires, interpretix e notes 
S2.S per package of 10 feedback (observer) questionnaires 
S.xS per package of 10 developmental guides 
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Leadership/lmpact 

Human Syneigistics 
2 1 6 Campus Drive 
Arlington Heights. IL 6()()04 
Phone: H47-590-099? 

Fax: 847-590-0997 
Email: infb@hsear.eoni 
1 n t e r n et : vv \v w . h sctir . eo m 

Purpose 

Leadership/Impaet is designed to show leaders how their per- 
sonal styles afTeci their organi/.aiions. 

Target Group 

Leaders in all type.s ol' organi/ation. 

Description 

Leadership/lnipaet is a 360-degree feedhack instrument eonsis:- 
ing ol'iwo main .seetions. “Impaet on Others" eonsists of ninety-six 
questions assessing the degree to which the leader causes others to act 
in certain ways. Responses range from 0 ("not at ail") to 4 ("to a very 
great extent"). The twelve categories are humanistic-encouraging. 
affiliati\e. approval, conventional, dependent, avoidance, opposi- 
tional. power, competitive, perl'ectionistic. achievement, and self- 
actuali/.ing. 

"L.eadership .Stralegics" consists of sixty items asscs.siiig the 
degree to which the leader uses ten different strategies: envisioning, 
role modeling, mentoring, stimulating thinking, referring, monitor- 
ing. providing feedback, reinforcing, influencing, and creating a 
setting. Responses range from 0 ("never") to 4 ("always"). 

Forms are provided for self-assessment and assessment by oth- 
ers. In addition to these two sections, participants are asked to 
indicate the type of effect they wani to have on others (“ideal im- 
pact"). 

Feedback 

Participants receive verba! and graphic feedback in three main 
.sections. First, they arc presented with data showing their ideal 
impact compared with actual impact as reported by peers, as.sociates, 
and supervistirs. 
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Second, they receive iecdback on “Impact on Others," which 
shows the degree to which others respond with constructive styles, 
passive/del'ensive styles, or aggressivc/defensive styles. Scores arc 
normed on a sample of 500 leaders. Item-by-item feedback is also 
provided, with direct comparisons of the leader's assessment and 
feedback from others. 

Third, they receive data on “Leadership Strategies," showing the 
degree to which they use .strategics that arc prescriptive (encouraging 
others to take positive actions) or restrictive (restraining others from 
taking negative actions). Item-by-item feedback is provided for each 
of the ten strategies, with direct comparison of self-a.ssessment and 
feedback from others. 

Followup 

Participants are provided with a detailed confidential leedbaek 
report, containing a section on “The Next Steps" with several goal- 
setting activities. Recommended readings are also listed. 

Theory and Rationale 

Leadership Impact is based on the assumption that leadership is 
best measured by the imparl that leaders have on other people in their 
organizations. 

Administration 

Participants complete a papcr-and-pencil survey form. 

Statistical Validation 

Not provided with review materials. 

Uses 

Leadership/lm(Kict is most approiniate for professional develo|v 
menl. 

Cost 

$175 per kit. which includes materials for .self and eight others, 
scoring, and feedback report. 



Leadership Orientations 

Di. Lee Holman 
Rm .108. Bloch 

Bloch School of Business and Public Administration 
University of Missouri 
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51 10 Cherry Street 
Kansas City. MO 6411 0~2201 
Phone: 816-235-5407 
Fax:816-333-9775 

Purpose 

Leadership Orientations was developed by Ixe Bolman and 
Terry Deal for use as a research instrument and a professional devel- 
opment aid. 

Target Ciroup 

Leadership Orientations is suitable for leaders in a variety of 
domains. 

Oescription 

The first of three sections consists of thirty-two items on a five- 
point Likert-type scale: it asks participants to indicate how often each 
statement is true of them, from “never" to "always." The second 
section consists of six forced-choice questions asking participants to 
de.scribe their style. The final section asks them to rate their effective- 
ness as leaders and managers in comparison with other individuals 
with similar levels of experience and responsibility. Similar versions 
arc available for rating by others. 

Feedback 

No feedback materials were supplied with review materials. (The 
instrument was originally designed for research and is not being 
marketed as a commercial product.) However, participants can easily 
.score their own results, which illumine their relative orientations on 
four main scales: structural, human resource, political, and symbolic. 
There are also subscaies for analytic, supportive, powerful, inspira- 
tional. organized, participative, adroit, and charismatic. 

Little explanatory material is provided with the in.strumcnts. but 
the authors have de.scribcd the four main orientations in other publi- 
cations; see. for example. Lee Bolman and Terry Deal (1991 ). 

Followup . 

None available. 

Theory and Rationale 

Leadership Orientations is built around theory and research that 
has identified four “frames" that leaders can use to think about their 
work: stmctural, which emphasizes goals, planning, and coordina- 
tion; human n’souni\ which is sensitive to the human needs of 
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others; political, which rocogni/cs the ways that people seek (o 
advance their own interests; and symholic, which focuses on the 
rituals, myths, and ceremonies that give meaning to organizational 
culture. 1 he assumption is that all four frames play important roles in 
ef feet i ve leadersh i |i . 

Administration 

Leadership Orientations can be self-administered and self-scored. 

Statistical Validation 

Extensive evidence of reliability is provided with the instrument. 
LJses 

Leadership Orientations has been tised maiiiK' for research, but it 
can be helpful in pi\)fessional development if facilitated by someone 
familiar with the fotir-frames concept. 

Cost 

None. 'I'he authors rotilinely grant permission for noneominer- 
cial. research use of the instrument. They do ask that tisers |irovide 
them with copies of any research reports produced using results from 
the instrument. 



Leadership Practices Inventory (LPI) 

.lossey-Bas.s/Pfoil’er 
3,'sO Sansome .Street 
5lh Flour 

San Franci.sco. CA 94104-1.342 
Phone: SOO-274-4434 
Fax: 800-. 369-044 3 
www.Jbp.com 

Purposf- 

"As you set out to train others, we ask that you share in our 
purpose- - /o help iiherate the leader in everyone." 

Target Croup 

Letiders at all levels in all organizations. 

Oescriplion 

rile LPI consists of thirlv itetns loctised on fiv i- key leadership 
practices: challenging the process, inspiring a shared \ ision. enabling 
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Others to act. modeling the way. and eneouraging the heart. Items use 
a ten-point Likert scale ranging from 1 (almost never) to 10 (almost 
always). A self-report and an observer rating can he used by superi- 
ors. subordinates, peers, or others. 

Feedback 

The feedback provides overall ratings for (he five dimensions ol' 
leadership, as well as a breakdowm of individual items. Participants 
are presented with side-by-side eomparisons of how their self-ratings 
compare with those of superiors, subordinates, and eoworkers. The 
feedback includes percentile rankings using a norm group consisting 
of all leaders and obserwrs who have taken the LP! since 198S. 
Participants are also given a rank-order listing of all items. 

Theory and Rationale 

The LPl is based on e.xtcnsive research by .himes Kou/.es and 
Barry Posner (hat foeu.sed on how ’‘ordimiry people accomplish 
extraordinary things." Leaders were asked to describe a “personal 
best" leadership experience. Their responses showed a consistent 
pattern ihai tlte reseiirehers encapsulaied in the five pracliees that are 
at the heart of the I..P1. 

Adm in isf ration 

Self-administered. I'he publishers advise that participants solicit 
the involvement of supervisors, subordinaies, and peers who will be 
completing the observer form. Scoring can be done on-site by a 
facilitator, using the scoring software pro\ ided by the publishers. 

Statistical Validation 

The publishers report high reliability for the LIM. as well as 
excellent face validity. In addition, factor analysis studies show that 
ihe five practices are separate entities. A variety of studies have 
linked LPl performance v\ ith various measures of on-the-job success 
(examples are given in the facilitator's handbook). 

Ftjllowup 

The publishers provide a facilitator'sguide that outlines a followup 
meeting to explain the results and begin the developmeni process. 
Participants are gi\en a handbook that interprets the scores and 
recommends activities for professional development. Under the head- 
ings “learning by doing," “learning from others." and “learning in the 
classroom or on your own." the workbook offers professional-devel- 
opment suggestions for each of the five practices. 

1U5 



98 MEASURING LEADERSHIP 



Uses 

The instmmeni is inicndccl and most appropciaie for profos- 
sioniil-dcvelopnient aciiviiies. 

Cost 

The Ix'adership Praolicos Inveniory — Individual Coiiirihuior (LPi- 
IC’) Faciliuiioi.s Guide indiides one copy each of tlie self and ob- 
server insirumenis and scoring sofiware. Quanlily discoanis arc avail- 
able. 

LPl-IC Facilitators Guide— $49. y.'s 
LPl-IC: Self— $12.95 
I.Pi-IC: Observer— $3.95 



Leadership Skills 

Acumen 

4(){)0 Civic Center Drive 
5th I'loor 

San Rafael. CA 94903 
Phone: 800-544-8629 
Fax:415-479-5358 
Hmail: aeumenCn'aeumen.com 
www.acLimen.coin 
('ontact: Jeannie ISlrod 

Purpose 

Leadership Skills seeks to stimulate leadership development by 
informing leaders of their skills in major leadership domains. 

Target Group 

Leaders of organi/ations in a wide range oi' industries, including 
education. 

Description 

l.eadership Skills is a multirater instrument that provides feed- 
back on sixteen leadership skills in four domains: task management 
(informing, efficiency, planning, and problem-solving); team devel- 
opment (performance feedback, relationship skills, staff develop- 
ment, and team moti\ation); business values (quality improvement, 
customer focus, and promoting innovation); and leadership (account- 
ability. empowerment, inllucnce, mission skills, and networking). 






106 




INSTRUMENT PROFILES 99 



The inslrumeni coiilains % items using a 5-pi)int Likert scale ranging 
froni I (”nevcr’') to 5 ("always"). 

Feedback 

Participants receive grapliic aticl narrative fecilhack. including 
summary results and item-by-item breakouts comparing self-.scores 
and ratings by others. Detailed interpretive information is provided. 

Followup 

The feedback report includes many activities and ideas for using 
the results for professional developtnenl. 

Theory and Rationale 

Not provided in review materials. 

Administration 

Can be sclf-adminislcrcd. Scoring provided by intblisher. 

Statistical Validation 

Not provided with review mtiterials. 

Uses 

The tnosl appropriate ii.se is for professional development. 

Cost 

Cost varies I'rotn $14? to depending on quantity, proees.s- 
ing. and the method selected to capture data. 



Leadership Sphere Inventory (LSI) 

Development Dynamics 
P.O. Box 26026'" 

Austin. TX 787.?5 
Phone: .?12-4?0-IS54 
Fax: 512-450-1854 
Hmail: AwmsmithCkiol.eom 

Purpose 

The LvSI is designed to help leaders understand how (hey view 
(heir roles and priorities as leaders. 

Tarj>et Group 

Anyone in a leadership role — executives, administrators, eom- 
manders. managers, and supervisors. 
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IL>oscriptic»n 

The LSI is a seir-assessineiil inslrumeiil lliat seeks lo measuiv 
liow leaders balance (he dilTerenl elemeiiis of leadership style, Ii 
consists of 24 items that ask participants to rank ord'ci a set ol 
herh;i\'iors and belief's I'rom 1 ("least indicatise”) to 5 ("most mdica 
tive"). In eaeh case, participants are asked to rank the items baseil on 
present beha\'ior and potential (ideal) behavior, The cjiicstions \ield 
data on the relative strengths oi' I'our major styles; interveners, 
implementers. iinprowrs. aiul inno\'aiors. Thcic is also an "iiitc 
grated” style with \ arious combinatiotis ol' the first foui'. Discrepan- 
cies between present behavior and ideal behavior indicate ilevelop 
mental needs. 

rood l>ac:k 

I'he I, SI provides directions lor parlici[ianls to sell-sairc their 
responses. Numerical and graphic feevlback is provided, ihoiigli (be 
review materials incliKled little narrative explanation. 

Followup 

The test is structured to provide direction lor tiev cloimicnial 
activity, hut the review materials did not include extensive ilcvclo|' 
ment activities. A separate manual prov ides more detailed interprcia 
tion and apidicalions. 

Tlit'ory iind K.itionale 

The l.Sl is based on research and field studies focuseil on the vv av 
that indiv iduals view tlicir relative roles aiul priorities as Icailers. 

Aciniinistration 

'fbe l.Sl is .self-administered aiul self-seored. 

Slalistical Validation 

Not provided with review materials. 

IJ St'S 

The I ,S1 is designed for self-ev aluation and |iidlcssional dev clop 
ment; it “should not be used to assign or change one's work position 
or status (»r to evaluate one's work performance.” 

Cost 

.Several options of insiruinents and iiackages are available to 
individualize the LSI for each organization. Inc|iiirc at Development 
Dynamics Idr details. 



108 




INSTRUMENT PROFILES 101 



Leadership Workstyles 

Acumen 

4()0() Civic Cenler Drive 
5th Floor 

San Rafael. CA 94905 
Phone: 800-544-8626 
Fax: 415-479-5.558 
Email: acuiricn@acumen.com 
wvvw.ucumcn.com 
Contact: Jeannie Elrod 

Pu rpose 

Leadership Workstyles seeks to stimulate leadership develop- 
ment by informing leaders of their characlcrislic styles. 



Target Group 

Leaders of orcani/ations in a wide ramie of industries, including 
cdiicalion. 

Description 

Leadership Workstyles is a mulliratcr instrument that pro\ ides 
feedback on twelve stylistic dimensions: humanislie-hclpful, affilia- 
tion, approval, conventionaL dependence, apprehension, oppositional, 
power, competition, perfectionism, achievement, and self-actiializa- 
tion. (A version of the instrument may be taken online at Acumen's 
website.) 

Feedback 

Participants receive graphic and narrati\c feedback, with an 
emphasis on showing how their style helps and hinders four major 
management functions: managing tasks, managing people, matuiging 
con n ids, and influencing/leading others. The report also summarizes 
perceptiems oi'other raters and proxddcs a comparative analysis. 

Followup 

I'he feedback report includes brief suggestions about using the 
results to increase managerial effectiveness. 

Theory arid Rationale 

Not i)rovided in review materials. 

Administration 

Can be self-administered. Scoring provided by publisher. 
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Statistical Validation 

Not provided with review materials. 

Uses 

The most appropriate u.'ie is for professional development. 

Cost 

Cost varies from $145 to $185 depending on quantity, process- 
ing, and the method selected to capture data. 



Life Styles Inventory (LSI) 

Human Synergislics 
216 Campus Drive 
Arlington Heights. IL 60004 
Phone: 847-590-0995 
Fax: 847-590-0997 
Email: info@hscar.com 
WWW. hscar.com 

Purpose 

The LSI is designed to increase productivity and develop leader- 
ship by helping participants understand their style of thinking, behav- 
ing. and inleracting. 



Tarj»et Group 

Leaders in all types of organizations. 

Description 

The Life .Styles Inventory is a 360-degree feedback instrument 
that assesses twelve basic thinking ptitterns. or styles: huniani.stic- 
encoLiraging. affiliative, appa)val. conventional, dependent, avoid- 
ance. oppositional, power, competitive, perfeclionistic. achievement, 
and self-actualizdng. These arc further grouped into categories of 
“constructive." “passivc/defensive,” or “aggressivc/defensive." The 
inventory contains 240 itetns in the form of words or short phrases: 
participants are asked to respond with a "2" if the word is “like you 
most of the time,” “1” if the word is "like you quite often." or "0” if 
the uord is “essentially unlike you.” 

The “L.SI 1” is the .self-assessment form; the “LSI 2” is aimed at 
cliciling feedback from others. 
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Feedback 

Participants receive self-assessment information (LSI I) in the 
form of a graphic “circumplex" that charts the relative strengths of 
each of the twelve styles. In each case, scores are characterized as 
"high,” “medium,” or “low,” based on a norm group of 9,207 indi- 
viduals. The LSI 2 adds a similar plotting for responses of others, and 
also adds fourteen "summary perceptions” showing how others view 
the person being assessed. Detailed interpretations are provided in 
.self-development guides for both LSI I and LSI 2. 

Followup 

The publisher provides self-development guides for both LSI 1 
and LSI 2 that contain extensive development activities, including 
"thought starters” and "change suggestion.s” for each style. 

Theory arid Ratioi^^ale 

The LSI is based on the assumption that behavior is caused by 
thoughts and self-concept, and therefore it can only be understood by 
knowing those thoughts. 

Administration 

Self-administered and self-scored. The LSI I takes 20-.T0 min- 
utes to complete and 10- 1 5 minutes to score; the LSI 2 requires 2()-.^() 
minutes to administer and 45-60 minutes to score. 

Statistical Validation 

Not provided with review materials. A bibliography cites a num- 
ber of published research studies probinp the reliability and validity 
of the LSI. 

Uses 

The LSI is most appropriate for professional development. 

Cost 

The LSI 1 kit, which includes self-inventory, LSI 1 self-develop- 
ment guide, and profile summary cards, is .$29. The l.Sl 2 kit. which 
includes five “description by others" inventories. LSI 2 .self-develop- 
ment guide, scorer's worksheet and instructions, and profile supple- 
ment. costs $51 . The combined kit for LSI I and LSI 2 is $70. 



IVlyers-Briggs Type Indicator (N4BTI) 

Consulting Psychologists Press 
.^80.^ K. Bayshore Road 
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Palo AlU), CA 94303 
Phone: 800-624-1765 
Fax: 650-969-8608 
www.cpp-'db.com 

Purpose 

The MBTI is designed for use in a wide \’ariely of' settings, 
including business, counseling, and eduealion. for personal and orga- 
nizational dex'clopment, team building, counseling, identification of 
learning styles, and many other activities. 

Target Group 

Anyone from age 14 to adult. 

Description 

The MBTI is not speeificalh' a leadership assessment, but it 
assesses personal traits that affect the ways leaders interact with 
others and carry out their jobs. Form G (self-scorable) contains 
ninety-four items that determine preferences in four areas: exlravcr- 
sion-introversion. sensing-intuition, thinking-feeling, and judging- 
perceix ing. These four areas are further combined into sixteen per- 
sonality '^lypes.'* Inventory items are forced-choiec. asking partici- 
pants to choose between preferred behaviors or appealing words. 

Feedback 

Form G (sell-seorable) prox ides brief explanations of the f'our 
major areas as xvell as the sixteen personality types. The publishers 
provide a variety of more detailed narrative reports as xvell as ad- 
vanced versions o\' the in.>triiment that provide expanded inteiprcta- 
lions. 

Followup 

The publishers offer a number of btvnks and x’ideo materials that 
explore the implications and applications of the MBTI. 

Theory and Rationale 

The MB'n is based on the personality theory of Carl Jung, who 
believed that human beings could be eategori/.etl iiUo several psycho- 
logical tx'pes. each of xvhieh xx as characterized by certain ixuterns of 
thinking and behavior. Through repeated empirical assessments, the 
MITFI has refined these ix pes into the current configuration. 

Administration 

Form (} (self-scorable) can be self-administeivd and sanvd. 
Hoxxever, users must meet certain qualifications to license the mate- 
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rials, including a degree from an acredited college or university and 
successful completion of a course in the interpretation of psychologi- 
cal tests and measurement at an accredited college or university. 

Statistical Validation 

Information on validity and reliability is available in the publisher's 
manual on the MBTl (not reviewed). 

Uses 

As noted above, the MBTl has many uses. School leaders may 
find it most useful in understanding how their actions and relation- 
ships are affected by their preferred style. 

Cost 

Form G (self-scorable.) for the MBTl is available for S37.50 for a 
package of ten. 



ISIASSP Assessment Centers 

National Association of Secondary School Principals 

Office )f Professional Development and As.scssmcnt 

1904 Association Drive 

Reston. VA 20191 

Phone; 703-860-0200 

Fax; 703-476-.3432 

WWW. nassp.org 

Purpose 

The N.ASSP assessment centers are designed to help school 
districts identify and develop leadership talent. 

Target Group 

School leaders or potential school leaders. 

Description 

The NASSP assessment process irscs a variety of siimilalcd 
leadership tasks to assess the skills of those serving as school leaders 
or aspiring to school Icadcrshi]') jtosiiions. Tasks include group dis- 
cussions. role plays, inbasket problems, oral presentations, and writ- 
ten papers, with evaluation being done by specially trained observers. 
Key skills include educational leadership (setting instructional direc- 
tion. teamwork, and .sensitivity); resolving comple.x problems (judg- 
ment, results orientation, and organi/.ational ability): communication 
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skills (oral communication and written communication): and devel- 
oping self and others (development of others and understanding own 
strengths and weaknesses). 

The assessment is usually administered in a day-long session at 
one of over forty assessment centers around the country, followed in 
several weeks by a feedback session. 

In addition to this assessment process (“Selecting and Develop- 
ing the 21st Century Principal’'), NASSP offers two related assess- 
ments: Leadership Early Assessment Program (LEAP), aimed at 
establishing or refining a career-advancement plan for potential or 
cuirent leaders, and the Superintendent Leadership Development 
Program (SLDP), designed to help cuiTcnt and potential superinten- 
dents construct a development plan (not intended for selection pur- 
poses). 

Feedback 

Participants receive written and oral feedback including develop- 
ment options several weeks following the assessment. 

Followup 

The feedback session includes discussion of development plans. 
NASSP offers fourteen or fifteen development programs appropriate 
for following up on the results of the assessment. 

Theory and Rationale 

The main assessment process ("Selecting and Developing the 
21st Century Principal'') is newly revised, based on research by the 
Interstate School Leaders Licensure Consortium (ISLLC), National 
Policy Board for Educational Administration (NPBEA), and the 
National Association of Secondary School Principals. 

Administration 

Assessments are conducted and followed up by trained assessors, 
typically at a regional assessment center (however, NASSP will 
provide training for local districts to conduct assessments). 

Statistical Validation 

Several validation studies have been conducted on the NASSP 
Assessment Center approach, and others are planned for the future. 

Uses 

The primary NASSP assessment process (“Selecting anti Devel- 
oping the 21st Century Principal'') can be used for selection, promo- 
tional readiness, or professional development. 
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Cost 

The cost varies among the regional assessment centers, each of 
which sets its own fee schedule. 



The Principal Perceiver 

The Gallup Organization 
P.O. Bo,\ 5700 
Lincoln. NE 68505 
Phone: 402-489-9000 
Fax:402-486-6317 
vvww.gallup.com 

Purpose 

The Principal Perceiver is designed for the selection and develop- 
ment of school leaders. 

Target Croup 

Inservice principals or prospective principals. 

Description : 

The Principal Perceiver consists o'" a structured interview con- 
ducted and scored by a trained facilitator/assessor. The instrument is 
designed to identify twelve key "themes” in the beliefs and behaviors 
of school leaders; commitment, ego drive, achiever, developer, indi- 
\ idualized perception, relator, stimulator, team, arranger, command, 
discipline, and concept. 

Feedback 

Participants or users receive verbal and written feedback show- 
ing scores on each theme and overall score. Graphic feedback shows 
low and high areas. The scoring is based on "ideal answers” rather 
than empirical norm. 

FolHowup 

None indicated in review materials, though the publishers sug- 
gest that the results can be used to identify areas of strength and 
w'eakness. 

Theory and Rationale 

Perceiver interviews are ba.sed on the belief that people shov\' 
spontaneous, recurring patterns of thought, feeling, and behavior that 
predict how' they are likely to perform in a given situation. Through 
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empirical research, the publishers have eslablished conelalions be- 
tween key indicators and job perP rmance. 

Administration 

The Principal Perceiver must be administered, scored, and inter- 
preted by a trained and certil'icd assessor. Districts may arrange to 
have staff members become certified, or the Gallup Organization will 
provide someone to conduct interviews and feedback by telcplione. 

Statistical Validation 

Not provided w'ith review materials. 

Uses 

.Selection and/or development of K-12 school administrators. 

Cost 

The Principal Perceiver. which is administered, .scored, and inter- 
preted in a structured interview by a trained assessor in the course of 
a four- to five-day training seminar, costs $2. l.'iO per person. 



Professional Development Inventory 

National As.sociation of Elementary School Princijials 
Ibl.'i Duke Street 
.Mexandria. VA 22.G4 
Phone; 70.V684-.TM.'^ 

Fax; 70.V? 1 8-62<S I 
Contact: Merrie Hahn 
vvwvv.naesp.org 

Pu rpose 

The PDl is an individual performance assessment designed to 
serve as a tool for sharpening understanding of the tcehnieal and 
practical aspects of the prineipalship. It can be used for diagnosing 
inservicc needs, for preparing for licensing or recertification require- 
ments, and for developing a personal professional-growth plan. 

Tarj*et Group 

The PDl is suitable for elementary or sectmdtiry principals. 

[>escriplion 

The PDl is a one-day pei formtince tissessmcnt offered at licensed 
assessment centers affiliated with NAESP. It involves seven exer- 
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ctses designed lo “simulaie a day in the life of a school principal." 
The activities require role playing or written responses. 

The assessment measures thirteen dimensions of leadership that 
arc grouped under the following five typical responsibilities of prin- 
cipals: instruction, organizational development, supervision a id evalu- 
ation of staff, communications, and human relations. The thirteen 
dimensions ofschool leadership are as follows: planning, organizing, 
problem-solving, creativity, decisiveness, systems analysis, vision, 
communications, instructional leadership, group leadership and team 
building, climate development, moral responsibility, and instruc- 
tional analysis. 

Feedback 

Participants generate video and written responses that are evalu- 
ated hy specially trained and e.xperienced practitioners. Their feed- 
back report identifies specific behaviors that contributed to the scores 
on each of the thirteen dimensions. Skill levels on each dimension are 
rated as exceptional, adequate, or inadequate, and the report includes 
percentile scores measured against a national databa.se of experi- 
enced principals. 

Fixeeptional scores are at the eighty-lburth percentile or above, 
whereas inadequate scores are those falling at the sixteenth percentile 
or low'd'. Percentile ratings for specific behavioral descriptors are 
akso included. 

The report is a\ ailablc about three weeks after the assessment and 
is delivered in a one-on-one conference. The participant is the sole 
recipient of the report. 

Followup 

The feedback report identifies areas that could benefit from 
development, with some suggestions for improvement; however, 
these are not specifically keyed to the PDl. It also li.sts resources such 
as seminars, training institutes, bibliographies, AV/computer resources, 
and project.s/activities that can be executed in the organizational 
context of the school. 

Theory and Rationale 

The PDl w'as developed in the 19S()s by a team of practitioners 
and academics at the University of Washington and has been exten- 
sively refined since then. The content and methods have been drawn 
from the effective-schools literature, surveys of practicing school 
administrators, studies documenting the relationship between self- 
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awareness and performance enhancement, and school district find- 
ings on the effectiveness of training experiences tailored to an initial 
diagnosis of individual needs. 

Administration 

The PDI must be taken at designated assessment centers and 
requires a full day. 

Statistical Validation 

Content and construct validity have been established for the PDI; 
reliability is controlled by the licensing requirements and by the 
process established for administration and scoring. A concurrent 
validation project is currently under way. and studies of predictive 
validity will afso be carried out. 

Uses 

The PDI is used primarily as a professional development tool, 
and is not appropriate for .selection or other employment decisions. 

Cost 

Varies. Districts wishing to have NAESP conduct an as.scssmcnt 
onsite must pay for travel, overnight accommodations, and per-diem 
for two role players and one lead trainer, as well as a .$400 hono- 
rarium for each role player. In addition, there is a $400 pcr-participant 
fee for each simulation conducted and scored by NAESP. Eiccn.scd 
organi/.ations (state principals’ associations and universities) may 
conduct and .score their own simulations for a per-participant I'ee of 
$170. and may set rates for conducting simulations. 



Profile of Aptitude for Leadership (PAL) 

Training House, Inc. 

P.O. Box 3090 
Princeton. NJ 08.$43 
Phone: 609-452-1.50.$ 

Fax: 609-243-9368 

Purpose 

PAL is designed to identify and stimulate thinking about leader- 
ship style. 
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Target Group 

PAL can be used with leaders in all types of organizations. 

Description 

The instrument consists of twelve sets of four statements each 
describing the leader’s beliefs or actions. Participants have six points 
to assign to the four statements in whatever combination best ex- 
presses their leadership stance. For example, six points could be 
given to one statement and no points to the other, or two statements 
could be given two points each while the others received a single 
point, and so forth. Results indicate the degree to which a leader 
operates as managcr/administra’or, supervisor/coach. entrei)reneur/ 
visionary, and technician/spccialist. 

Feedback 

The tests are self-scored and self- recorded. I'he results are based 
on the distribution of seventy-two possible points: the higher the 
score, the stronger the style. 

Followup 

The feedback form includes basic intciprclivc comments, along 
with several reflective questions on each of the four styles. 

Theory and Rationale 

The basis for the four styles is not specifically addressed in the 
review materials, though each category is frc(]uently found in thi'ory 
and research about leadership. PAL assumes that every leader uses all 
four styles to varying degrees and that all four are necessary. 

Administration 

PAI. can be .self-administered and self-scored in less than thirty 
minutes. 

Statistical Validation 

Not included with review materials. 

Uses 

PAL is most appropriately u.sed for dcvclopmeut. 

Cost 

The minimum cost is $80 for a .set of 20 packets; additional 
copies cost $4.00 each for 21 to 90 copies. One hundred copies cost 
$320. with $3.20 for each additional copy. 
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The Survey of Leadership Practices 

The Clark Wilson Groii[i 
1320 I’CMwick l.anc 
Siiilc 708 

Silver Spring. MD 2(W10 
Phone: 800-^37-7240 
Fax: 30I-40.S-.S842 
www.ewgine.eom 

Purpose 

The SLP is a imilliraler assessinenl designed lo give organi/a- 
lional leaders feedhaek on (heir elTorls lo move ihe organi/.alion 
toward positiv change. 

Tarj«cf Group 

Organi/alional leaders, including middle and senior managers, 
project leaders, and professional people who must huild support for 
their innov ations. 

I >escriplion 

I'lie SLP is based on the eoneepi of six "task eyele" skills 
required for bringing change to organi/alions: entrepreneurial vision 
(vision/imagination and risk-taking/venluresomene.ss); letulership Ibr 
change (organi/ational .sensiliviiv and encouraging participation); 
gaining coniniilmenl (leaming/empovvering and persiitisivenessi; 
monitoring personal impact (feedhaek): drive (standards of perfor- 
mance. energy, perseveianee. and ptish/pressiircK and reeogni/ing 
performance (sharing credit). 

Feedback is also prm ided on “residual impact" (effeetivx'ness/ 
OLiIccmies. coping with stress, and trustworthiness), as well as "svHirees 
of power" (how the leader .seeks lo influence people). 

fhe inventory contains 8.3 items on a 7-poinl Likert scale, rang- 
ing from 1 ("never or lo a small extent") to 7 falways or lo a great 
e.xtenl"). In addition, three open-ened questions ask w hat the leader 
should continue doing, .stop doing, and do lo become more effective. 

Feedback 

Participants receive v erbal, graivhic, and numerical feedback and 
interpretations for each of the task cycle skills, residual impact, and 
sources of power, fhe report shows summarv seerres for each cat- 
egory, as well as ilem-by-item breakouts. .Self-ratings are compared 
with those of siqvervisors. peers, and subordinates. Summary scores 




INSTRUMLNT PROhlLES 113 



include percentilo ratings based on a large sample of managers. 
Results Tor open-ended questions are also listed. 

Followup 

The ntirrativc I'eedbaek report includes briefadviee for deveioi)- 
ment. A resource guide providing more extensive development assis- 
tance is also available (not provided witli revievv materials). 

Theory and! Rationale 

'I’he SLP is ba.sed on tlie idea that leadership depends on skill in 
aceomplishing a sequenced series ol'task.s. beginning with vision and 
eoneluding with recognition orperrormance. Skill on these tasks will 
be related to the leader's perceived elTectiveness. 

Administration 

Sur\’eys may be administered in peneil-and-paper I'orm or online. 
Certil'iealion is required to administer the siirxey and provide I'eed- 
baek. 

Statistical Validation 

Considerable evidence on \alidity ol the .SLP is provided. A 
re, search bihliogniphy cites numerous studies using the SI.P aiul 
closely related instruments. 

LJsos 

Most appropi iate Tor i)rofessional de\ elopment. 

dost 

ILieh survey is $21, which ineltules the cost of scoring, Quantity 
discounts are available. 



The Survey of /Vtanagement Practices 

riie Clark Wilson Group 
1320 P'envvick Lane 
.Suite 708 

Silver Spring. Ml) 20910 
Phone; 800-5.37-7249 
Fax; 301-495-5842 
wvv vv.cvvgine.com 

Purpose 

The SMF is a mulliraler as.scssnienl designed to give orgatii/.a- 
lional leaders feedback on their management skills and practices. 
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Tarj»ef Group 

Supci visors or others responsible Ibr clay-U'-day activities o( an 
organizatuni. 

Oescription 

The SMI’ is based on the concept of six “task cycle" skills 
required for managing organizations efl'ectively: making goals clear 
and important (elarifieation of goals and objectives); |ilaniiing ami 
problem-solving (upward communication, orderly work planning, 
and expertise); faciliiating the work of others (work facilitation); 
providing feedback: exercising positive control (time emphasis, con- 
trol of details, goal pressure, delegation); and reinforcing g(K)d per- 
formance (recognition for good performance). 

Feedback is also provided (m interpersonal relations (approach- 
ability. teambuilding, interest in subordinate growth, and building 
trust), as well as group motivation and morale (work involvement, 
cc'worker competence, team atmosphere, opportunity for growth, 
tension level, orgunizalion climate, general morale, and commit- 
ment). 

The inventory contains 14.S items on a 7-point Likert scale, 
ranging from 1 (“never or to a small extent") to 7 (“always iir to a 
great extent''). 

Feedback 

Participants receive verbal, graphic, and numerical feedback and 
interpretations for each of the task cycle skills, interpersonal rela- 
tions, and group motivation and morale. The report shows summary 
scores for each category, as well as item-by-item breakouts. .Sell- 
ratings are compared with tho.se of supervisors, peers, and subordi- 
nates. Summary .scores include percentile ratings based on a large 
sample of managers. 

Followup 

The narrative feedback report includes brief advice for develop- 
ment. A re.source guide providing more extensive development assis 
tance is also available (not provided with review materials). 

Theory and Rationale 

The SMP is based on the idea that effective management depends 
on skill in accomplishing a sequenced series of tasks, beginning with 
goal-setting and concluding with recognition for good performance. 
The .SMP a.ssumes that effective managers are tho.se who balance 
structure with consideration. 
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Administrstion 

Surveys may be administered in pencil-and-papcr rorm or online. 
Certification is required to administer the survey and provide feed- 
back. 

Statistical Validation 

Considerable evidence on validity of the SMP is provided. A 
research bibliography cites numerous studies using the SMP and 
closely related instruments, 

Uses 

Most iippropriate for professional development. 

Cost 

Each survey is $21. which includes the cost of scoring. Quantity 
di.scounts are available. 
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1 he ^^easlIrc of a 
!>cnder 

What Do Leadership 
iests Measure? 



I_^arry Lashway guides district administrators 
and principals through the maze of issues on 
leadership assessment: what leadership is, how 
to select an instrument, and how' to interpret and 
use the data it generates. Descriptions of about 
twenty instruments are included. 

The book focuses less on detailed descrip- 
tions of instruments than on a process that be- 
gins with reflection on the district's leadership 
needs and ends when participants begin to act on 
the implications of the results. 



Selecting (he Ik'St 
instrument 

Fulfilling the Ih'omise 
of As.sessmcnt 

Instrument Fnillles 



Kenneth Keilhwnnd vivs: 

"Written primarily for those with districtwdde 
responsibilities, this is a ‘how to' book for 
school-leader selection, appraisal, and devel- 
opment. It is written extremely well with this 
audience in mind. And while the author 
touches, of necessity, on only a sample of the 
total set of leadership instruments that are 
available, he provides quite useful guidance 
for district administrators no matter wiiich 
leadership instruments they select for their 
own purposes." (From the foreword) 
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